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Introduction 


For  some  time  the  course  has  concentrated  on  discrete-valued  stochastic  processes 
{ Xn ;  n  =  0, 1,...}  developing  in  discrete  time.  In  this  unit  we  turn  our  attention  to 
discrete  processes  {X(t);  t  >  0}  developing  in  continuous  time.  Specifically,  we  shall 
be  looking  at  situations  where  the  random  variable  X(t )  takes  non-negative  integer 
values  only;  for  example,  X(t )  may  be  the  number  of  events  which  have  happened 
by  time  t,  or  the  number  of  individuals  alive  at  time  t  in  an  evolving  community, 
or  the  number  of  individuals  in  a  community  who  by  time  t  have  caught  a  disease, 
or  have  heard  a  particular  item  of  information. 

Some  stochastic  processes  are  non-decreasing;  for  instance,  we  might  be  counting 
arrivals  at  a  particular  location,  where  individuals  arrive  according  to  a  Poisson 
process.  A  typical  realization  is  shown  in  Figure  1.1. 


Another  example  of  a  non-decreasing  process  is  the  simple  birth  process. 
Individuals  born  into  a  community  themselves  independently  generate  further 
offspring  according  to  a  Poisson  process.  The  more  individuals  there  are  alive  at 
any  time,  the  more  frequent  the  incidence  of  births  is  likely  to  be.  A  typical 
realization  is  shown  in  Figure  1.2. 


Size  of 
population 


Figure  1.2 


Realization  of  a  simple  birth  process 


Many  stochastic  processes  are  subject  to  decrease  as  well  as  increase.  For  instance, 
if  departures  occur  as  well  as  arrivals,  then  the  number  of  individuals  present  at  a 
location  can  fall  as  well  as  rise.  Examples  of  this  type  include  the  number  of 
aircraft  on  the  ground  at  an  airport,  or  the  number  of  customers  present  in  a 
supermarket.  A  realization  is  shown  in  Figure  1.3. 


Another  example  of  this  type  is  a  birth  and  death  process;  in  this  case,  members  of 
a  community  generate  offspring  as  in  a  birth  process,  but  an  added  feature  is  that 
individuals  do  not  live  forever — they  die,  at  some  random  age,  and  so  the 
population  size  goes  down  as  well  as  up. 

In  this  unit  we  consider  only  processes  which  are  either  non-decreasing  or  non¬ 
increasing.  We  discuss  the  Poisson  process  and  the  simple  birth  process,  with 
which  you  are  already  familiar,  and  a  process  which  is  a  combination  of  the  two; 
these  processes  are  all  non-decreasing.  We  also  look  at  a  death  process;  in  this,  a 
community  which  may  be  quite  large  initially  eventually  vanishes  once  everybody 
in  it  has  died.  There  are  no  births  or  arrivals  from  outside  to  balance  the  deaths, 
so  this  is  a  non-increasing  process.  Processes  which  both  rise  and  fall  are  left  until 
the  next  unit. 

We  start  by  looking  again  at  two  familiar  processes:  the  Poisson  arrival  process 
and  the  simple  birth  process.  These  familiar  models  are  used  as  vehicles  for  the 
development  of  a  general  method  for  analysing  integer-valued  continuous-time 
processes.  This  re-examination  takes  up  the  first  two  sections  of  the  unit.  The 
general  method  of  analysis  involves  the  solution  of  a  particular  form  of  differential 
equation  known  as  Lagrange’s  equation.  A  technique  for  its  solution  is  described 
in  Section  3,  which  is  by  far  the  longest  section  of  the  unit.  It  deals  with  a 
mathematical  notion  and  not  specifically  with  random  processes;  and  to  help  fix 
ideas,  a  number  of  examples  are  used  which  are  not  drawn  from  chance  contexts. 

In  the  fourth  and  fifth  sections  of  the  unit,  the  approach  developed  in  Sections  1 
and  2  and  the  technique  described  in  Section  3  are  applied  in  the  context  of 
several  different  random  processes.  One  of  the  processes  considered  in  Section  4 
involves  births  and  random  arrivals  occurring  in  combination,  and  this  model  is 
analysed  in  an  audio-tape  session.  Section  5  deals  with  a  model  for  random  death. 

Although  the  third  section  of  the  unit  is  rather  long,  both  the  second  and  fifth 
sections  are  very  short  indeed.  You  should  not  find  that  you  run  out  of  time;  but  if 
it  starts  to  look  as  though  you  might,  you  can  leave  the  whole  of  Subsection  4.2 
until  later  in  the  year,  when  it  would  provide  useful  revision  material. 

As  already  stated,  both  the  Poisson  process  and  the  simple  birth  process  are 
studied  in  this  unit,  and  not  for  the  first  time  in  the  course.  However,  there  is  no 
need  to  reread  any  preceding  units  in  order  to  prepare  for  this  one,  as  the 
approach  adopted  in  this  unit  is  quite  new.  The  reason  for  choosing  familiar 
processes  is  so  that  you  can  concentrate  more  on  the  approach  and  less  on  the 
particular  random  processes  to  which  it  is  initially  applied. 

The  two  mathematical  ideas  which  are  introduced  in  this  unit — functions  of  two 
variables  and  the  solution  of  a  differential  equation— do  not  require  any 
preparation  on  your  part;  everything  you  need  to  know  is  contained  in  the  unit. 
Although  this  unit  does  not  depend  on  any  earlier  ones  to  any  great  extent,  you 
should  note  that  the  unit  is  itself  essential  preparation  for  Unit  8.  Together,  these 
two  units  constitute  a  fundamental  approach  to  stochastic  population  processes, 
and  many  of  the  ideas  introduced  here  are  used  again  later  in  the  course. 

There  is  no  video  component  associated  with  this  unit. 
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1  The  Poisson  process 


The  Poisson  process  is  the  simplest  of  the  various  integer-valued  continuous-time 
processes  that  are  studied  in  this  course.  There  are  many  applications  where  it  can 
be  used  as  a  model:  for  example,  in  counting  radioactive  emissions  from  an 
isotope,  recording  arrivals  at  a  bank  or  at  a  doctor’s  surgery,  or  representing  the 
incidence  of  meetings  between  members  of  a  community.  Most  of  the  time  when 
talking  of  applications  we  speak  of  an  arrival  process,  or  use  the  more  common 
technical  term  immigration  process. 

We  may  be  concerned  with  either  the  arrival  times,  as  depicted  in  Figure  1.1,  or 
the  corresponding  realization  in  Figure  1.2,  which  shows  the  total  number  of 
arrivals  so  far. 


i - 

Figure  1.1 


t 

The  incidence  of  events  in  an  arrival  process 
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Figure  1.2  The  number  of  events  in  an  arrival  process 

Usually  it  is  the  second  process  of  the  two  that  is  considered,  the  integer-valued 
process  {A'(t);  t  >  0},  which  is  a  non-decreasing  process  developing  in  continuous 
time. 


1.1  A  fresh  look  at  the  Poisson  process 

We  shall  now  take  a  fresh  look  at  the  Poisson  process,  using  a  different  method 

from  that  used  in  M245  to  derive  the  distribution  of  the  random  variable  X(t),  M245  Unit  5,  Section  1 

which  represents  the  total  number  of  events  (emissions,  arrivals,  meetings)  during  M  3-  2  Urt  $ 

the  time  interval  [0 ,t].  This  method  is  applicable  to  many  other  random  processes, 

some  of  which  you  have  met  before;  for  example,  the  simple  birth  process  and  the 

simple  birth-death  process. 

We  begin  by  re-stating  the  postulates  of  the  Poisson  process.  See  Unit  2-  Subsection  3.2. 

I  The  probability  that  (exactly)  one  event  occurs  in  any  small  time  interval 
[t,t  +  <5f]  is  equal  to  A  St  +  o(St). 

II  The  probability  that  two  or  more  events  occur  in  any  small  time  interval 
[£,  t  +  <5t]  is  equal  to  o(<5t). 

III  The  occurrence  of  events  after  any  time  t  is  independent  of  the  occurrence  of 
events  before  time  t. 

In  practice  it  is  not  necessary  to  write  out  the  complete  set  of  postulates 
corresponding  to  every  different  random  process  modelled.  The  important 
information  is  contained  in  the  first  postulate,  which  may  be  written  as 

P(X{t  +  St)  =  x  +  1 1  X{t)  =  x)  =  /.St  +  o(St).  (1.1) 

In  general,  a  brief  statement  such  as  this  is  used  to  describe  concisely  the  various 
processes  discussed  in  this  unit.  It  is  always  assumed  that  the  probability  that 
more  than  one  event  occurs  in  the  short  time  interval  [t,  t  +  St ]  is  negligible 
(Postulate  II),  and  that  the  occurrence  of  events  before  and  the  occurrence  of 
events  after  any  time  t  are  independent  (Postulate  III). 
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The  probability  P(X(t)  =  x)  is  denoted  by  pJt):  or,  more  precisely, 

P(X(t)  =  x  |  X(0)  =  0)  =  px(t).  Then 

jtPo(t)=  (1.2a) 

.  jtPx(t)= -*Px{t)  + APx-i{t),  x  =  1,2, ...  .  (1.2b) 

In  Unit  2,  these  equations  were  set  up  for  the  non-homogeneous  Poisson  process, 
of  which  the  Poisson  process  is  a  special  case.  These  equations  are  called  the 
differential-difference  equations  for  the  Poisson  process:  differential  because  the 
equations  involve  derivatives,  difference  because  they  express  the  probability  px(t ) 
in  terms  of  the  probability  px_1(t). 

When  analysing  the  Poisson  process  in  M245,  and  the  ^^homogeneous  Poisson 
process  in  Unit  2  of  this  course,  the  procedure  followed  is  a  recursive  one.  In  the 
case  of  the  homogeneous  Poisson  process,  solution  of  the  first  differential- 
difference  equation,  which  is  an  ordinary  differential  equation  involving  only  p0(t), 
gives  p0(t)  =  e~Xt  for  the  initial  condition  po(0)  =  1.  Subsequent  probabilities 
Pi(t),  p2(t),...  are  established  recursively  using  Equation  (1.2b).  Eventually  a 
pattern  becomes  clear,  and  it  is  deduced  that,  for  x  =  0, 1,...  , 

PM  =  P(X(t )  =  x)  = 

That  is,  the  distribution  of  X(t)  is  Poisson  with  mean  It. 

This  is  really  a  rather  long-winded  approach,  involving  the  solution  of  a 
conceptually  infinite  number  of  differential  equations,  and  the  risk  that  no  ‘pattern’ 
becomes  evident.  So  instead  we  shall  follow  a  procedure  which  does  not  have  this 
drawback. 

The  approach  involves  the  probability  generating  function  of  the  random  variable 
X(t),  which  is  defined  to  be 

CO 

E{sm)=  Z  P(X{t)  =  x)sx 

x  =  0 

=  Z  Px(t)sX. 

x  =  0 

This  is  a  function  involving  both  s  and  t ,  so  to  emphasize  the  functional 
dependence  on  two  variables,  it  is  denoted  by  n(s,t);  that  is, 

n(s,0=  Z  Px(t)s*.  (1.3) 

x  =  0 

Eventually,  we  shall  replace  the  set  of  differential-difference  equations  (1.2),  for  the 
set  of  probabilities  {px(t)},  with  a  single  equation  whose  solution  is  the  probability 
generating  function  n(s,  t).  Before  doing  this,  functions  of  two  variables  are 
discussed  briefly;  all  you  need  to  know  is  contained  in  Subsection  1.2.  We  return 
to  p.g.f.’s  and  the  Poisson  process  in  Subsection  1.3. 


1.2  Functions  of  two  variables 

For  the  moment  we  shall  set  aside  ideas  about  probability,  random  variables  and 
random  processes;  not  all  functions  relate  to  chance  phenomena,  and  this  will 
allow  us  to  use  a  greater  variety  of  examples. 

You  are  familiar  with  functions  of  one  variable:  for  example,  the  function 
/(x)  =  2.54x  (x  >  0)  converts  measurements  in  inches  to  measurements  in 
centimetres.  There  are  many  other  simple  functions:  /(x)  =  sinx,  g(t)  —  log (2  +  t), 
h(w )  =  1  —  e~Xw  are  three  examples.  You  can  evaluate  these  functions  at  particular 
values  of  the  argument— /(7t/6)  =  0.5,  g(1.2)  =  1.16,  h( 2)  =  1  —  e~2X — and  you 
should  know  how  to  differentiate  and  integrate  them.  When  dealing  with  functions 
of  more  than  one  variable  in  this  course,  nothing  more  complicated  is  required. 


In  general,  the  probability  px(t) 
means  a  conditional  probability 
P(X(t)  —  x  |  Y(0)  =  x0)  for  some 
value  of  x0,  but  it  is  left  as  an 
implicit  rather  than  explicit 
condition. 


In  Unit  2,  the  more  general  result 
for  the  rj^-homogeneous  Poisson 
process-was-preved -by  induction. 


Functions  of  two  variables  are 
studied  in  M203  and  MST204. 
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Example  1.1  Car  insurance  premium 


A  motor  insurance  company  decides  that  it  will  determine  the  annual  premium 
that  a  motorist  must  pay  for  comprehensive  cover  on  his  or  her  car  as  a  function 
of  the  motorist’s  age,  a ,  and  the  rated  capacity,  c  (in  cubic  centimetres),  of  the  car 
engine.  Thus  the  premium  (measured  in  £)  can  be  written  as  f(a,c)  and  depends  on 
the  two  variables  a  and  c.  The  formula  adopted,  for  a  >  17  and  c  >  0,  is 
f(a,c)  =  0.Se~OAa  c1-2. 

So,  for  instance,  a  32-year-old  driving  a  2-litre  car  pays  an  annual  premium  of 
/( 32,2000)  =  0.8  e  3'2(2000)1:2  =  £298.25,  and  a  50-year-old  at  the  wheel  of  a 
5.3-litre  car  pays  /( 50, 5300)  =  £  158.76.  You  can  see  directly  from  the  formula  that 
the  premium  is  higher  for  young  drivers  than  it  is  for  older  ones,  and  that  it  is 
higher  lor  larger  cars:  it  decreases  with  increasing  a,  but  increases  with  c.  □ 

A  function  /(x)  of  a  single  variable  x  can  be  represented  as  a  curve  drawn  in  two 
dimensions.  For  example,  the  graph  of  the  function  /(x)  =  3e~x,  x  >  0,  is  drawn  in 
Figure  1.3.  A  function  f(x,y)  of  two  variables,  x  and  y,  can  be  represented  by  a 
surface  in  three  dimensions;  this  is  illustrated  in  the  following  example. 


Figure  1.3  The  graph  of 

/(x)  =  3e~x,  x  >  0 


Example  1.2 

The  function  f(x,y)  =  x2  +  y2  +  1  for  real  x  and  y  is  represented  by  the  surface 
shown  in  Figure  1.4. 


Figure  1.4  The  graph  of 

f(x,y)  =  x2  +  y2  +  1,  (x, y)e  IR2 

For  instance,  setting  x  =  1  and  y  =  2,  we  obtain  /( 1,2)  =  l2  +  22  +  1  =  6,  so  the 
surface  is  6  units  high  above  the  point  (1,2).  □ 


When  dealing  with  a  function  of  a  single  variable,  notions  of  ‘steepness’  are 
quantified  through  the  operation  of  differentiation.  For  the  function /(x), 
successive  differentiation  with  respect  to  x  is  denoted  by  the  sequence  of 

d3f 


df  d2f 

denvatlves  S?  3?’  3? 


The  situation  is  similar  when  two  variables  are 


defined,  but  now  we  are  dealing  with  a  function  of  the  form  f{x,y),  so  a  different 
notation  must  be  used. 


In  general,  the  first  partial  derivative  of  /  with  respect  to  x  is  defined  by 

df  =  |-  f{x  +  Sx,y)-f(x,y) 

Ox  a*-o  Sx 

and  the  first  partial  derivative  of  /  with  respect  to  y  by 

df  =  f(x,y  +  Sy)-f{x,y) 
dy  *y-o 

provided  that  these  limits  exist. 


The  left-hand  sides  are  read 
partial  d  fbydx  and  partial  df  by 
d  y.  Notice  the  way  the  partial  ds 
are  written. 
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r  r 

The  process  of  calculating  the  partial  derivatives  —  and  is  called  partial 

r 

differentiation.  From  the  definitions  it  follows  that  — ,  the  first  partial  derivative  of 

ox 

/with  respect  to  x,  is  found  by  differentiating  the  function  f(x,y)  with  respect  to 
the  variable  x  while  regarding  the  second  variable  y  as  a  constant,  and  the  first 
8f 

partial  derivative  is  found  by  differentiating  f(x,y)  with  respect  to  y  while 
regarding  x  as  a  constant. 


Example  1.3 

The  function  f(x,y)  is  defined  for  all  real  x  and  y  and  is  given  by 
f(x,y)  =  x3  +  y2  -  xey. 

The  first  partial  derivative  of  /  with  respect  to  x  is  found  by  differentiating  with 
respect  to  x  while  regarding  y  as  a  constant,  so 

f  =  3x2  -  * 

OX 

The  first  partial  derivative  with  respect  to  y  is  found  by  differentiating  with  respect 
to  y  while  regarding  x  as  a  constant,  so 

^f  =  2y-  xey.  □ 


Example  1.1,  continued 

For  the  function 

/(«,c)  =  0.8  e~0Aac1,2, 

the  first  partial  derivative  with  respect  to  a  is 

/  =  — 0.08e“°'lt‘c1,2. 
da 

It  describes  how  the  premium  changes  as  an  individual  driving  a  car  of  capacity  c 
ages.  Note  the  sign  of  the  derivative:  the  premium  decreases  with  increasing 
age.  □ 


Question  1.1  Find  the  first  partial  derivatives  for  each  of  the  following  functions, 
which  are  defined  for  all  real  x  and  y. 

(i)  /(x,y)  =  sin(x2  +  y) 

(ii)  g(x,jO  =  xey  +  x2y  □ 

Second-  and  higher-order  partial  derivatives  are  found  in  a  similar  way.  For 
instance,  the  second  partial  derivative  of  /  with  respect  to  x  is 

dx2  dx\dxj' 

It  is  a  notable  feature  of  partial  differentiation  that,  when  differentiating  both  with 
respect  to  x  and  with  respect  to  y,  the  order  of  differentiation  does  not  matter; 
whether  differentiating  first  with  respect  to  x,  then  with  respect  to  y,  or  first  with 
respect  to  y,  then  with  respect  to  x,  the  result  is  the  same.  So  the  mixed  derivative 
is  defined  to  be 

a2/  _  e  (df\_  d(df\_  d2f 

dxdy  dx\dyj  dy\dxj  dydx' 


This  is  true  for  the  sort  of  function 
you  will  meet  in  this  course. 


Example  1.3,  continued 

The  second  partial  derivative  with  respect  to  x  of  the  function 
f(x,  >■)  =  x3  +  y2  —  xey  is 

a2/ 


dx: 


=  ±(V\  =  JL 

dx  \<3x /  dx 


(3x2  —  ey )  =  6x, 


and  the  second  partial  derivative  with  respect  to  y  is 

Pf-±(d£\-<Ln  _ 

'  dy\dy)  dy{2y 

d2f 


dy2 

The  mixed  derivative 


dx  dy 

and  then  with  respect  to  x,  giving 


xey)  =  2  —  xey. 
is  found  either  by  differentiating  first  with  respect  to  y. 


d2f  d  (df\  d 

hdy  ~  dx  ~  dxi2y  ~  Xe>)  ~  ~  ey’ 


dx  dy 

or,  reversing  the  order  of  differentiation,  by  differentiating  first  with  respect  to  x, 
and  then  with  respect  to  y,  i.e. 

a- id 


□ 


Question  1.2  Find  the  second  partial  derivatives  and  the  mixed  derivative  for 
each  of  the  functions  in  Question  1.1.  □ 


1.3  An  alternative  approach 


The  probability  generating  function  n(s,  t)  of  a  discrete  random  variable  X(t) 
whose  distribution  depends  on  the  time  t  is  a  special  case  of  a  function  of  two 
variables.  From  Subsection  1.1  we  have  the  differential-difference  equations  (1.2), 

jtPQ{t)=  -Xp0{t),  (1.2a) 

jtPx(t)=  -lpx(t)  +  lpx- j(4  x  =  1,2,...  ,  (1.2b) 

and  U{s,t),  the  probability  generating  function  of  the  random  variable  X(t),  was 
defined  in  Formula  (1.3)  by 

U(s,t)  =  £  px(t)sx.  (1.3) 

x  =  0 

We  shall  now  obtain  an  equation  involving  JI(s,  t),  and  possibly  its  partial 
derivatives,  from  the  family  of  differential-difference  equations. 

Firstly,  for  x  =  0, 1, . . .  ,  multiplying  Equations  (1.2)  by  sx,  we  have  (since  s°  =  1) 
JtPo(t)  =  -*Po(t\ 

JtP^)sX  =  ~}-Px(t)sx  +  /-px-i{t)sx,  x  =  1,2,...  . 


Adding  these  equations  gives 

d  *  d  c0  00 

JtPo(t)  +  I  -TtPx(t)sX=  -lp0(t)-A  X  px{t)sx  +  A  X  Px-i(t)sX. 

UL  x=lal  x=\  x=l 

The  left-hand  side  is 


Z  ~T.  Px(t)sx, 

x  =  0al 


which  can  be  written 


as 


d_ 

dt 


ff  (s,t)  or,  more  simply,  as 


dn 

dt ' 


(1.4) 


Here  we  have  assumed  that  the 
derivative  of  the  sum  is  equal  to  the 
sum  of  the  derivatives. 
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On  the  right-hand  side  we  have  two  separate  sums:  the  first  is 

CO  00 

-Ap0(t)-A  X  px(t)sx  =  -A  X  Px{t) sx  =  -  An (s,t); 

x=l  x=0 

the  second  is 


00 


co 


X  Apx_1{t)sx  =  As  X  Px-i(t)sx  \ 


and,  making  the  change  of  variable  j  =  x  —  1,  this  becomes 

CO 

As  X  Pj(0  sj  =  As  n(s,  t). 

j= o 

So  altogether  on  the  right-hand  side  of  Equation  (1.4)  we  have 

-An(s,t)  +  Asn(s,t)=  —  A(i  -s)n(s,o=  —  A(i  -s)  n, 

and  so  Equation  (1.4)  can  be  written  as 

rr 

—  =  —  A(1  -s)n.  (1.5) 

This  is  a  partial  differential  equation  for  EI(s,  t),  the  probability  generating  function 
of  the  total  number  of  events  that  occur  by  time  t  in  a  Poisson  process.  It  is 
effectively  a  summary  of  the  differential-difference  equations  (1.2),  for  the  sequence 
of  probabilities  {px(t)},  expressed  in  the  form  of  a  single  equation. 


A  method  for  the  solution  of  first-order  partial  differential  equations,  of  which  this 
is  an  example,  is  developed  in  Section  3.  For  the  moment,  you  should  notice  that 
the  partial  differential  equation  (1.5)  involves  differentiation  with  respect  to  t  only, 
not  both  s  and  t.  So,  regarding  s  as  a  constant  and  applying  the  rules  of  ordinary 
differential  equations,  we  can  integrate  this  equation  directly,  using  separation  of 
variables,  to  obtain 

logn=  -A(l  -s)r  +  A{sl  (1.6) 

where  /l(s)  is  an  arbitrary  function  of  s.  Then,  taking  exponentials,  we  have 

U  =  U(s,t)  =  A{s)e-M1~s)t,  (1.7) 

and  this  is  the  general  solution  of  the  partial  differential  equation  (1.5). 

The  arbitrary  function  /l(s)  is  evaluated  using  the  initial  condition  A'(O)  =  0  (no 
events  have  occurred  at  time  zero).  If  76(0)  =  0  with  probability  one,  then 
II(s,0)  =  1.  Setting  t  equal  to  0  in  the  general  solution  (1.7)  of  the  partial 
differential  equation  (1.5)  gives  /4(s)  =  1  for  all  s,  so  the  particular  solution  is 

n  (s,  t)  =  e~Xt(1~s). 

This  is  the  p.g.f.  of  a  Poisson  distribution  with  mean  At,  and  so  X(t)  ~  Poisson(At); 
this  is  the  result  that  has  been  deduced  previously  by  recursive  solution  of  the 
differential-difference  equations  (1.2). 


The  details  of  this  result  are  given 
later.  For  now  observe  that,  since 

--4(s)  =  0,  partial  differentiation  of 
ot 

both  sides  with  respect  to  t  gives 
Equation  (1.5). 

The  arbitrary  function  T(s)  on  the 
right-hand  side  of  Equation  (1.7)  is 
not  the  same  as  the  function  which 
appears  in  Equation  (1.6),  but  they 
are  both  arbitrary  functions  of  s,  so 
there  is  no  point  in  using  a 
distinguishing  notation. 


In  this  case  we  have  a  partial  differential  equation  for  the  probability  generating 

o  n 

function  II(s,  t)  involving  only  terms  in  IT  and  — ,  and  this  can  be  solved  using  the 

rules  of  ordinary  differential  equations.  In  the  next  section,  which  is  very  short,  a 
partial  differential  equation  is  obtained  for  Il(s,  t),  the  probability  generating 
function  of  the  population  size  at  time  t  in  a  simple  birth  process.  This  involves 

both  the  partial  derivatives  ^  and  and  requires  the  techniques  developed  in 

Section  <f  to  solve  it. 
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2  The  simple  birth  process 


U 

The  simple  birth  process  was  described  briefly  in  Section  ^of  Unit% .  If  you  have 
studied  M245,  you  will  have  seen  the  differential-difference  equations  derived  for 
the  probability  distribution  of  the  number  of  individuals  alive  at  time  t  in  a  simple 
birth  process.  In  this  section,  we  start  with  the  postulates  of  the  simple  birth 
process,  and  obtain  from  them  the  differential-difference  equations  for  the  sequence 
of  probabilities  {px{t)},  which  gives  the  probability  distribution  of  X{t),  the 
population  size  at  time  t.  Then  the  differential-difference  equations  arc  rewritten  in 
the  form  of  a  partial  differential  equation  for  U{s,t),  exactly  as  for  the  Poisson 
process  in  the  preceding  section. 

Actually,  we  shall  not  write  the  postulates  in  full;  all  we  really  need  is  an 
expression  for  the  instantaneous  growth  rate  at  lime  t  given  the  population  size  at 
that  time.  Remember  the  model:  each  individual  alive  in  the  population 
independently  generates  further  offspring  according  to  a  Poisson  process  at  rate  /?; 
and  there  are  no  deaths,  so  the  population  simply  increases  as  time  passes.  If  at 
time  t  the  population  size  is  x,  then  the  waiting  time  to  the  next  increase  in 
population  size  is  distributed  as  the  minimum  of  x  independent  exponential 
variates  M((4),  and  so  is  exponential  with  parameter  /?x.  So  we  simply  write 

P(X(t  +  St)  =  x+l\  X(t)  =  x)  =  fix  St  +  o(St ),  (2. 1 ) 

matching  Equation  (1.1)  for  the  Poisson  process. 

To  find  the  unconditional  distribution  of  the  population  size  at  time  t,  we  proceed 
as  before  to  set  up  the  differential-difference  equations,  which  describe  the  likely 
population  size  at  time  t  +  St  in  terms  of  the  size  at  time  t. 

The  community  must  start  with  at  least  one  member,  for  otherwise  it  would 
remain  unpopulated  forever  as  there  would  be  nobody  to  give  birth  to  anybody 
else.  So  we  need  not  consider  the  possibility  X(t  +  St)  =  0.  We  begin  by 
considering  the  probability  that  there  is  one  individual  present  at  time  t  +  St.  By 
the  Theorem  of  Total  Probability, 

Px{t  +  St)  =  P(X(t  +  St)  =  1) 

CO 

=  X  P(X(t  +  <50  =  1 1  X{t)  =  x)  P(X(t)  =  x). 

x  =  0 

The  event  [X(t  +  St)  =  l]  can  happen  only  if  there  is  a  single  individual  present  at 
time  t  and  this  individual  has  no  offspring  in  the  time  interval  [t,t  +  St],  so 

Pi(t  +  St)  =  pl{t)(  1  -  (1  St  +  o(Stj). 

Rearranging  this  and  taking  the  limit  as  St  ->  0,  we  obtain  the  first  differential- 
difference  equation  for  the  simple  birth  process: 

^Pi(0  =  ~PpM  (2.2) 

For  larger  population  sizes,  we  must  also  consider  the  possibility  of  a  birth  in  the 
time  interval  [ t ,  t  +  St],  although  we  can  discount  as  ‘very  unlikely’  the  possibility 
of  more  than  one  birth  in  this  time  interval,  since  by  Postulate  II  this  has 
probability  o{St). 

If  there  are  x  individuals  alive  at  time  t,  then  the  probability  that  there  is  no  birth 
in  the  time  interval  [t,t  +  <5r]  is  1  -  pxSt  +  o(<5r).  If,  on  the  other  hand,  there  are 
x  —  1  individuals  present  at  time  t,  then  the  probability  of  one  birth  in  the  time 
interval  [t,t  +  St],  bringing  the  population  size  up  to  x  at  time  t  +  St,  is 
IHX  —  1)<5*  +  o(St).  These  are,  essentially,  the  only  two  ways  in  which  there  can  be 
x  individuals  alive  at  time  t  +  St.  Therefore,  for  x  =  2,3,...  ,  we  have 

px(t  +  St)  =  px{t)(  1  -  fix  St  +  o(<5f))  +  px_1(t)(/j(x  -  1  )St  +  o{St))  +  o(St). 
Rearranging  this  and  taking  the  limit  as  St  -»0,  it  follows  that,  for  x  =  2, 3,...  , 

jt  Px(t)  = -  fix  px(t)  +  P(x-l)px_1  (t).  (2.3) 

If  x  is  set  equal  to  one,  then  the  second  term  on  the  right-hand  side  of  Equation 
(2.3)  vanishes  and  the  equation  reduces  to  Equation  (2.2).  So  we  need  not  consider 


M245  Unit  8 ,  Section  2 


Unit  %  Qiuprf6rr"2s8 


Strictly  speaking,  the 
the  population  size  at  time  t 
depends  on  its  size  at  time  0. 
Nevertheless,  we  shall  follow  our 
usual  practice  of  writing  the 
unconditional  probability 
P{X(t)  =  x)  rather  than  the  strictly 
correct  conditional  probability 
P(X(t)  =  x  |  Af(0)  =  x0),  and  worry 
about  the  initial  state  of  the  process 
later. 


distribution  of 


Like  that  derived  for  the  probability 
p0(t)  in  the  Poisson  process 
(Equation  (1.2a)),  this  is  not  a 
difference  equation  at  all,  just  an 
ordinary  differential  equation.  Its 
solution  is  the  first  step  in  the 
recursive  method  for  finding  px(t) 
which  is  used  in  M245. 


All  other  possibilities  have 
probability  o(St). 
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one  of  the  equations  separately  as  we  did  for  the  Poisson  process  in  Equations 
(1.2).  For  the  simple  birth  process  we  have  a  single  family  of  equations: 

=  -pxpx(t)  +  P(x  -  l)px-M  x  —  1,2,...  .  (2.4) 

As  before,  U(s,t),  the  probability  generating  function  of  X(t),  is  defined  by 

n(s,t)=  £  Px(t)s*. 

x  =  0 


In  this  case,  since  p0(t)  =  0  for  all  t,  we  have  the  slight  reduction 

CO 

n (s,t)=  £  px(t)sx. 

x=  1 

The  next  step  is  to  multiply  Equation  (2.4),  which  contains  —  px(t),  by  sx,  and  sum 
over  all  x  =  1,2,...  ,  giving 

OO  J  00  00 

E  jtPx(t)sx  =  -p  E  xpx{t)s*  +  P  E  (x  -  l)Px-i(t)sx-  (2.5) 

x=\aL  X=1  X=1 

On  the  left-hand  side  of  Equation  (2.5),  we  have 

I Jp*Ws*=in(s’t)=f'  (16> 

and  on  the  right-hand  side  we  have 

~P  E  xPx(t)sx  +  P  E  (x  -  1  )px_1(t)sx, 

X  =  1  X  =  1 

which,  on  making  the  change  of  variable  j  =  x  —  1,  can  be  written  as 

~P  E  xPx(t)sx  +  Ps  E 

x=l  j=0 

Since  the  first  term  in  the  second  sum  is  zero,  this  expression  can  be  rewritten  as 

CO  00 

~P  E  xPx(t)sx  +  Ps  E  jPj(L)sJ> 

x=\  ;= i 

which  simplifies  to 


— /i(l  —  s)  E 


(2.7) 


There  is  always  at  least  one 
individual  present  in  the  population, 
so  p0{t)  =  0  for  all  t. 


00 

Question  2.1  Rewrite  the  sum  £  xpx(t)sx  as  an  expression  involving  a  partial 

X=  1 


derivative  of  the  p.g.f.  II(s,  0-  □ 


In  answering  Question  2.1  you  should  have  found  the  useful  identity 

*  . ,  x  dYl 

ZxpMs  =S~. 


(2.8) 


Applying  this  result,  Expression  (2.7),  which  gives  the  right-hand  side  of  Equation 
(2.5),  becomes 


~Ps(  1 


And  now,  using  this  and  Result  (2.6),  Equation  (2.5)  can  be  rewritten  as  a  partial 
differential  equation  for  EI(s,  t),  the  p.g.f.  of  the  population  size  at  time  £  in  a  simple 
birth  process  with  birth  rate  (1: 


m 

dt 


R  (1  \SU 

-W-s)-. 


(2.9) 


This  partial  differential  equation,  unlike  that  for  the  Poisson  process,  involves  both 

of  the  first  partial  derivatives  —  and  — .  In  the  next  section  a  method  is 

os  Dt 

described  for  solving  partial  differential  equations  of  this  type;  this  is  used  in 
Subsection  4.1  to  solve  the  partial  differential  equation  (2.9)  for  the  p.g.f.  of  a 
simple  birth  process. 
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3  Lagrange’s  equation 


From  your  reading  of  other  courses,  you  may  be  familiar  with  the  solution  of 
some  partial  differential  equations  occurring  in  particular  contexts.  For  instance, 
you  may  have  come  across  the  wave  equation 

d2u  _  1  d2u 

where  u  is  a  function  of  x  and  t,  and  c  is  a  constant  ( MST322  Unit  13),  or  the  heat 
conduction  equation 

d2u  _  1  du 
dx2  kdt' 

However,  this  is  not  the  place  for  a  detailed  account  of  the  theory  of  the  solution 
of  partial  differential  equations.  At  present  we  are  concerned  only  with  the  solution 
of  one  particular  type  of  partial  differential  equation.  In  this  section  a  method  of 
solution  is  described,  but  there  is  no  explanation  of  why  the  method  works;  it  is 
introduced  simply  as  a  technique  which  will  enable  us  to  solve  certain  problems  in 
stochastic  processes. 


3.1  Statement  of  the  problem 

A  method  will  be  described  for  solving  partial  differential  equations  of  the  general 
form  in  Equation  (3.1): 

f(s,  t,n)~  +  g(s ,  (,  n)  ™  =  h(s,  t,  n).  (3.  i) 

This  equation,  in  which  the  functions  f,  g  and  h  are  functions  of  the  variables  s,  t 
and  n,  may  be  solved  following  a  method  given  in  1779  by  the  mathematician 
Lagrange,  and  for  this  reason  we  call  it  Lagrange’s  equation. 

Example  3.1  The  Poisson  process 

For  the  Poisson  process,  the  partial  differential  equation  for  Il(s,t)  is 

?-*-*»* 

In  Lagrange  form  it  is  written  as 

ox^!+ixy  =  -2(i  -s)  n, 
ds  dt 

so 

f(s,  t,  n)  =  0,  g(s,  t,U)  =  1,  h(s,  f,IT)  =  —  2(1  —  s)  n, 
or  we  can  write  simply 

/=  0,  g=  1,  /i  =  -2(1  -  s)  n.  □ 


Question  3.1  Write  the  partial  differential  equation  (2.9)  for  II(s,  t),  the  p.g.f.  of  the 
simple  birth  process,  in  Lagrange  form,  and  identify  the  functions  f,  g  and  h.  □ 


Example  3.2 


For  a  birth  process  in  which  the  instantaneous  growth  rate  of  the  population  is 
proportional  not  to  its  size  (as  in  the  simple  case)  but  to  the  square  of  its  size,  it 
can  be  shown  that  LI(s,r),  the  p.g.f.  of  the  population  size  at  time  t,  satisfies  the 
partial  differential  equation 


an 

dt 


„ ..  . ,  an 

=  -fis(  1  -  s)(  —  +  s 


This  involves  a  second-order  partial  derivative,  so  it  cannot  be  rewritten  in 
Lagrange  form.  □ 


J.  L.  Lagrange  1736-1813 


In  the  method  described,  n  occurs 
both  as  a  variable  and  as  a  function 
of  s  and  t,  n  =  fl(s,  t). 


This  is  Equation  (1.5)  of  Section  1. 


You  need  not  be  concerned  with  the 
details  of  how  this  partial  differential 
equation  was  found. 
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Now,  although  not  all  the  different  partial  differential  equations  for  the  different 
probability  generating  functions  which  arise  in  the  analysis  of  different  random 
processes  are  of  the  Lagrange  form  (3.1),  this  form  arises  quite  often  in  the  sort  of 
straightforward  contexts  with  which  we  deal  in  this  course,  so  it  is  worth  finding 
the  general  solution.  You  will  now  see  how  to  do  this. 


3.2  Solving  Lagrange’s  equation 

Throughout  this  section  the  notation  s,  t  and  II  is  used,  but  the  method  described 
is  of  general  application,  and  the  function  n  need  not  necessarily  be  the 
probability  generating  function  of  an  integer-valued  random  variable  with  a 
continuous  time  parameter,  with  all  the  restrictions  that  this  implies.  By 
considering  functions  which  are  not  necessarily  probability  generating  functions, 
we  can  draw  on  a  wide  field  of  examples  to  illustrate  the  method  described. 

Example  3.3 

A  solution  of  the  partial  differential  equation 

(2  +  t)f +  stf  =  sn  (12> 

is  given  by  the  function 

n  (s,  t)  =  t(  3  +  s2-(2t  + 4  log  t )),  (3.3) 

but  U{s,t)  is  not  a  probability  generating  function.  □ 


The  main  point  of  this  section  is  to  develop  a  technique  for  the  solution  of 
Lagrange’s  equation.  In  fact,  in  Subsection  3.1,  we  identified  the  first  step. 


Step  1 

Given  a  partial  differential  equation  in  which  the  first  partial  derivatives 

^  and  ^  occur  only  linearly  (if  at  all),  and  in  which  higher-order 

os  dt 

derivatives  do  not  feature,  rewrite  it  in  Lagrange  form 


jn  sn  , 

flF  +  glt  =  h’ 

where  /,  g  and  h  are  functions  of  s,  t  and  n;  and  identify  the  functions  /,  g 
and  h. 


Question  3.2  Rewrite  the  following  partial  differential  equation  in  Lagrange  form, 
and  identify  the  functions  /,  g  and  h: 


en  an  e.  _ 

t~r~  =  S—  +  S-(stU). 
ds  dt  8s 


□ 


The  next  step  is  to  write  down  the  so-called  auxiliary  equations  for  the  partial 
differential  equation.  These  are  a  trio  of  simultaneous  equations,  usually  written  in 
the  concise  form  of  Equations  (3.4)  below. 


Step  2 

Write  down  the  auxiliary  equations 

ds  dt  dll 

(3.4) 

f  g  h  ' 

Check  this  if  you  have  the  time. 


You  need  not  worry  about  the 
meaning  of  the  expressions  ds,  dt 
and  dYl  in  Equations  (3.4);  you  will 
see  how  the  equations  may  be 
manipulated  in  the  examples  which 
follow. 
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The  form  in  which  the  auxiliary  equations  are  written  in  Equations  (3.4)  is  simply 
a  convenient  way  of  writing  down  three  ordinary  differential  equations  associated 
with  the  partial  differential  equation.  For  example, 

ds  _  dt 
f  8 

represents  the  ordinary  differential  equation 
ds  _  / 
dt  g’ 

where  ^  is  the  derivative  of  s  with  respect  to  t.  And  so  Equations  (3.4)  are  also 
referred  to  as  differential  equations. 


Example  3.1,  continued 

For  the  Poisson  process,  the  auxiliary  equations  are 
ds  _dt  _  dYl 
0 -T=  -A(i  -s)ir  D 


Example  3.3,  continued 

For  the  partial  differential  equation 


,dn  dn 
(2  +  ')‘a7  +  s£"aF  =  sn’ 


we  have 


f=2  +  t,  g  =  st,  h  =  sll, 
and  so  the  auxiliary  equations  are 
ds  _  dt  _  dU 

2  + 1  st  sir  ’  n 


The  zero  denominator  probably 
looks  somewhat  strange  to  you.  You 
will  see  very  soon  how  to  cope  with 
expressions  of  the  form  dx/0. 


Question  3.3  Write  down  the  auxiliary  equations  for  the  partial  differential 
equation  of  Question  3.2.  □ 

This  brings  us  to  the  third  step,  which  is  to  solve  the  auxiliary  equations.  These 
involve  three  different  ordinary  differential  equations: 

ds  _dt  ds  _dU  dt  _  dU 
f  g'  f  h  ’  g  h 

Each  equation  is  obtained  by  choosing  two  of  the  three  terms  in  Equations  (3.4). 
This  trio  of  equations  actually  involves  only  two  independent  equations;  so,  of  the 
three  equations,  only  two  need  to  be  solved. 


Example  3.3,  continued 


From  the  trio  of  differential  equations  contained  in 
ds  _dt  _  dU 
2  + 1  st  sn  ’ 


we  must  solve  two.  The  best  approach  is  to  choose  the  two  whose  solution  is  most 
straightforward.  The  easiest  strategy  is  to  identify  those  where  the  variables  are 
separable.  For  instance,  taking  the  first  and  second  expressions,  we  have 
ds  _  dt 
2  +  t  (§[' 


Bringing  all  terms  involving  s  to  the  left-hand  side,  and  all  those  involving  t  to  the 
right,  this  may  be  rewritten  as 


s  ds  = 


2  +  t 


dt,  i 


(3.5) 


that  is, 


2  +  t 
t 
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This  equation  may  be  integrated  with  respect  to  t: 

or 


f2  +  r 


dt. 


(3.6) 


Observe  that  this  equation  is  just  Equation  (3.5)  with  the  addition  of  integral  signs. 
Because  the  variables  have  been  separated  in  Equation  (3.5)  we  can  write  down 
Equation  (3.6)  immediately.  This  is  what  will  be  done  in  future. 

It  follows  from  Equation  (3.6)  that 

%s2  =  2  log  t  +  t  +  constant. 

This  is  one  solution  of  the  auxiliary  equations.  To  find  a  second  solution,  we  take 
the  second  and  third  expressions  together,  giving 
dt  _  dll 
st  sFI  ’ 

This  involves  s,  t  and  II,  but  s  vanishes  on  cancellation  to  give  an  equation  in 
which  the  variables  t  and  El  are  separate.  Thus 


whose  soluj-ion  is 

logt  =  logn  +  constant. 

Taking  the  first  and  third  expressions  together,  we  have 
ds  _  dU 
2  +  t  sET 

which  involves  all  three  variables  s,  t  and  Id  in  an  irreducible  form.  Elowever,  we 
have  already  extracted  two  ordinary  differential  equations  from  the  three 
possibilities,  and  solved  them,  and  this  is  all  that  is  required.  □ 


The  term  constant  means  any 
constant ,  not  the  same  constant  as  we 
had  before. 


Example  3.1,  continued 

The  auxiliary  equations  for  the  Poisson  process  constitute  something  of  a  special 
case.  We  have  the  equations 
ds  dt  _  dU 

0~~T~  -2(1  -s) n' 

Taking  the  first  and  second  expressions  together  and  cross-multiplying  gives 


so  one  solution  of  the  auxiliary  equations  is 
s  =  constant. 

Now  we  require  a  second  solution.  At  first  sight,  the  equation  obtained  by  taking 
the  second  and  third  expressions  together  appears  to  involve  all  three  variables: 
dt  _  dll 
T  “  -2(1  -  s)W 

However,  we  know  from  our  first  solution  that  s  may  be  regarded  as  a  constant; 
so  we  can  solve  this  equation  by  treating  s  as  a  constant.  Rewriting  the  equation 
we  obtain 

f-i(i-s)*=  [gdn, 


This  result  would  also  follow  from 
the  first  and  third  expressions  taken 
together.  If  you  find  an  expression  of 
the  form  dx/0  featuring  in  the 
auxiliary  equations,  you  can  write 
down  the  solution  x  =  constant 
immediately. 

Remember,  the  auxiliary  equations 
are  simultaneous  equations,  so  the 
solution  for  one  can  always  be 
substituted  into  another. 


and  if  s  is  a  constant  this  has  the  solution 
—  2,(1  —  s)t  =  logn  +  constant.  □ 
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Question  3.4  Solve  the  auxiliary  equations  found  in  Question  3.3.  □ 

It  is  usual  to  end  the  third  step  by  making  the  constants  of  integration  the  subjects 
of  their  respective  equations;  that  is,  by  writing  the  equations  with  the  constants 
standing  alone  on  the  left-hand  side. 

Example  3.1,  continued 

In  this  case,  from  the  first  solution  we  have 
tq  =  s. 

The  second  solution  may  be  rewritten  in  a  number  of  ways:  for  example, 

-  constant  =  — /(l  -  s)t  —  log  Id, 
or 

constant  =  2(1  —  s)t  +  log  Id, 
or,  taking  exponentials, 

constant  =  Id  eM1  ~s)l. 

It  is  this  last  form,  where  the  constant  is  expressed  as  a  product  rather  than  a  sum, 
which  is  to  be  preferred.  Thus  we  have 

c2  =  nei,I"s)'  □ 

In  this  example,  it  would  not  be  wrong  to  write  the  second  solution  as 
c2  =  H 1  —  s)t  +  log  Id;  we  would  end  up  with  the  same  final  solution  to  the 
problem.  However,  if  for  no  other  reason  than  to  make  it  easy  for  you  to  follow 
the  unit,  it  is  useful  to  have  a  convention.  So  when  it  is  possible  to  rewrite  a 
solution  as  a  product  involving  the  exponential  function  rather  than  as  a  sum 
involving  the  logarithmic  function,  then  this  will  be  done. 

Example  3.3,  continued 

The  first  of  the  two  solutions  obtained  can  be  written  as 
constant  =  2  log  t  +  t  —  %s2, 
or 

constant  =  41ogr  +  It  —  s2. 

Taking  exponentials  gives 
Ci  =  t*e2,~s\ 

The  second  solution  may  be  rewritten  as 


Id 


The  third  step  of  Lagrange’s  method  of  solution  is  summarized  below. 


Step  3 

Solve  the  auxiliary  equations,  writing  your  two  solutions  in  the  form 
Ci  =  (f>i{s,  t,  Id),  c2  =  02(s,  t,  n). 


Question  3.5  Rewrite  the  solutions  found  in  Question  3.4  in  the  form 
Ci  =  t,  rd),  c2  =  02(s,  t,  Id).  □ 

There  is  a  little  further  to  go  to  find  the  solution  of  the  original  equation,  but 
before  moving  on  to  the  next  step,  try  the  following  question;  it  will  give  you  some 
more  practice  at  solving  auxiliary  equations. 


Question  3.6  Solve  the  following  sets  of  auxiliary  equations,  writing  your  answers 
in  the  form  cx  =  c2  =  (f)2(s,  t,  fl). 

...  ds  dt  dTl 
(I) 

....  ds  dt  dU 

(n)  n“7  =  T 


v  '  s  +  n  t  +  u  o 

The  next  step  is  to  write  down  the  general  solution  of  the  original  partial 
differential  equation;  this  is  the  solution  before  any  initial  conditions  are  taken 
into  account.  Whereas  the  general  solution  of  a  first-order  differential  equation 
features  an  arbitrary  constant,  the  general  solution  of  a  first-order  partial 
differential  equation  involves  an  arbitrary  function.  The  following  example 
illustrates  this. 

Example  3.4 

(i)  We  shall  show  that,  for  any  differentiable  function  i//,  n(s,  t )  =  f(s  —  t )  is  a 
solution  of  the  partial  differential  equation 

dU  dU  A 

aT+ *-a 


= i i/'(s  ~t)x  i{s  ~t)= ms  - 1)  x  (+ 1) 


^  =  Ms  -t)x  Jt(s  -t)  =  Ms  -  t)  X  (-  1), 


I }+8-§=ns-t)-ns-t)=o. 

(ii)  The  general  solution  of  the  partial  differential  equation 

an 


n(s,  t)  =  \s2  + 1 p(t), 

where  i //  is  an  arbitrary  function.  This  is  so  because,  in  obtaining  the  first 
m 

partial  derivative  — ,  t,  and  therefore  the  function  i p(t),  is  regarded  as  a 
constant. 

(iii)  The  general  solution  of  the  partial  differential  equation 

an  an  „  „ 

“a - ^7  +  n  =  2 

ds  dt 


n(s,  t)  =  2  -  e  SI J/(s  +  t), 

where  f  is  an  arbitrary  differentiable  function,  since 

n  |-r 

—  =  e~s\ /s{s  +  t)  -  e~si Ms  +  0 


dn 

-w=-e  ’/,(s  +  r)> 

and  the  result  follows.  Any  differentiable  function  i jj  gives  a  solution.  For 
instance,  setting  the  function  \f/(x)  equal  to  ex  gives  n(s,  f)  =  2  -  e1  as  a 
particular  solution;  and  setting  =  x  gives  n(s,£)  =  2  -  (s  +  t)e~s  as 
another  particular  solution.  However,  the  general  solution  contains  an 
arbitrary  function  i f/.  □ 
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So  far  we  have  solved  the  auxiliary  equations  to  yield  Cj  and  c2  on  the  left-hand 
sides  of  equations  which  have  expressions  involving  s,  t  and  IT  on  the  right.  In  fact, 
the  general  solution  of  the  original  partial  differential  equation  involves  these 
expressions  and  is  given  by 

c2  =  <A(c  i), 

where  i jj  is  an  arbitrary  function.  This  is  the  scheme  which  was  offered  by 
Lagrange  in  1779,  and  proved  by  him  in  1785. 


Example  3.1,  continued 

In  this  case  we  have 

c,  =  s,  c2  =  UeMl~s)t. 

The  general  solution  of  the  original  partial  differential  equation 

™  =  -A(l  -s)n 

is  therefore 

c2  =  >A(c  i), 

or,  substituting  for  the  constants  c,  and  c2, 

neA(1"s)1  =  i l/{s). 

So  the  general  solution  is 

n  =  n{s,t)  =  ^Js{s)e-w-s),, 
where  \f/  is  an  arbitrary  differentiable  function.  □ 

Example  3.3,  continued 

In  this  case  we  have 

_  y.4„2r  -s2  r  —  H 

Ci  —  i  e  ,  c2  —  — . 

So  the  general  solution  of  the  original  partial  differential  equation  (3.2)  is 

5  =  ^(tv-‘2) 

or 

n  (s,t)  =  nf,(t*e2'-s2), 

where  ij/  is  an  arbitrary  differentiable  function.  □ 


This  is  Equation  (1.7),  with  the 
arbitrary  function  i/ffs-)  replacing 
d(s). 


(3.7) 


In  both  these  examples  we  have  been  able  to  find  the  general  solution  from  the 
equation  c2  =  i/s(Ci).  But  suppose,  for  instance,  that  in  Example  3.3  we  had 
obtained  the  second  solution  of  the  auxiliary  equations  first,  and  so  written 
Ci  =  II/t;  in  that  case,  to  find  the  general  solution  we  would  have  needed  to  write 
c i  =  \jj(c2).  This  possibility  is  included  in  the  summary  given  below  of  the  step  of 
finding  the  general  solution. 


Step  4 

Write  down  the  arbitrary  functional  equation 

c2  =  ' Hci) 

(or  cx  =  ^(c2)),  and  rewrite  it  in  as  simple  a  form  as  you  can  to  give  the 
function  IT  =  LI(s,  t)  standing  alone  on  the  left-hand  side  of  an  equation 
involving  s,  t  and  the  arbitrary  function  \p  on  the  right-hand  side. 


Question  3.7  Find  the  general  solution  of  the  partial  differential  equation  of 
Questions  3.2-3. 5.  □ 


One  final  step  remains.  In  an  ordinary  differential  equation  the  arbitrary  constant 
in  the  general  solution  can  be  evaluated  by  reference  to  the  initial  conditions.  In  a 
similar  way,  the  arbitrary  function  in  the  general  solution  of  a  partial  differential 
equation  can  be  identified  after  reference  to  the  initial  conditions.  You  will  now  see 
how  this  works  for  the  Poisson  process. 

Example  3.1,  continued 

So  far  in  our  attempt  to  find  II(s,  t),  the  probability  generating  function  of  the 
random  variable  X(t )  in  a  Poisson  process,  we  have  the  equation 

n  (s,t)  =  iJj(s)e-M1-s)t.  (3.8) 

The  initial  condition  is  X(0)  =  0,  so  the  p.g.f.  of  X(0)  is  s°  =  1;  that  is,  ll(s,0)  =  1. 
Setting  t  equal  to  zero  in  Equation  (3.8)  gives  n(s,0)  =  1  on  the  left-hand  side,  and 
i \f/(s)e~M1~s)0  =  i f/(s)  on  the  right.  So  t j/(s)  =  1  for  all  s,  and  the  particular  solution 
required  is 

U{s,t)=  1  x  =  e~M1  ~s)t. 

This  is  the  p.g.f.  of  a  Poisson  distribution  with  parameter  At,  and  so 
X(t)  ~  Poisson(zlt).  □ 

Usually  it  is  a  somewhat  more  complicated  exercise  to  find  the  particular  solution 
corresponding  to  some  given  initial  condition,  as  the  following  example  shows. 

Example  3.3,  continued 

For  the  partial  differential  equation  (3.2)  we  have  derived  the  general  solution 

n(s,t)  =  tiMt*e2,-s2).  (3.7) 

Suppose  the  given  initial  condition  is  that  at  time  f  =  1  the  function  Il(s,  t)  is  equal 
to  1  +  s2.  Then,  setting  t  equal  to  1  in  Equation  (3.7),  we  find 

<A(e2-s2)=  1  +s2.  (3.9) 

We  need  to  identify  the  function  if/.  In  other  words,  we  want  to  know  i//(x),  when 
what  we  have  in  Equation  (3.9)  is  i J/{e2~s2).  Now,  if  we  write 
x  =  *2-s2, 

then,  rearranging,  it  follows  that 
s  =  y/2  -  log  x. 

So,  setting  x  =  e2~s2  in  Equation  (3.9),  the  function  if/  is  identified  as 
\f/{x)  =  3  —  log  x. 

Finally,  using  this  result  in  the  general  solution  (3.7),  we  find  that  the  particular 
solution  n  satisfying  the  given  initial  condition  is 

n(S,0  =  t(3-log(tV'-s2)); 

that  is, 

FI(s,  t)  =  t( 3  +  s2  -  (2 1  +  41ogt)). 

This  is  the  particular  solution  given  in  Result  (3.3).  □ 

The  final  step  of  the  procedure  is  summarized  below. 


Step  5 

Find  the  particular  solution  for  a  given  initial  condition  by  identifying  the 
function  if/  using  the  initial  condition  and  then  substituting  for  if/  in  the 
general  solution. 


Question  3.8  Find  a  particular  solution  for  the  function  Il(s,  t )  of  Question  3.7, 
using  the  initial  condition  that  at  time  t  =  0,  the  function  fl(s,  t)  is  equal  to  s.  □ 


i f/(t4e2,~sZ)  is  obtained  by  replacing 
x  with  t4e2,~s2  in  the  formula  for 
if/(x). 
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The  five  steps  involved  in  finding  a  particular  solution  of  Lagrange’s  equation 
satisfying  a  given  initial  condition  are  summarized  below. 


Procedure  for  solving  Lagrange’s  equation 

Step  1  Given  a  partial  differential  equation  in  which  the  first  partial 

dn  ,  on 

derivatives  —  and  —  occur  only  linearly  (if  at  all),  and  in  which  higher- 

order  derivatives  do  not  feature,  rewrite  it  in  Lagrange  form 

,dll  dn 

i-  s  —  K 

os  dt 

where  /,  g  and  h  are  functions  of  s,  t  and  n;  and  identify  the  functions  /,  g 
and  h. 


Step  2  Write  down  the  auxiliary  equations 
ds  _  dt  _  dll 
f  g  ~  h  ' 

Step  3  Solve  the  auxiliary  equations,  writing  your  two  solutions  in  the  form 

Ci  =  (f>i{st  t,  n),  c2  =  02(s,  t,  n). 

Step  4  Write  down  the  arbitrary  functional  equation 
c2  =  '/'(Cl) 

(or  Ci  =  i A(c2)),  and  rewrite  it  in  as  simple  a  form  as  you  can  to  give  the 
function  n  =  n(s,  t)  standing  alone  on  the  left-hand  side  of  an  equation 
involving  s,  t  and  the  arbitrary  function  i p  on  the  right-hand  side. 

Step  5  Find  the  particular  solution  for  a  given  initial  condition  by 
identifying  the  function  ij/  using  the  initial  condition  and  then  substituting  for 
i A  in  the  general  solution. 


This  section  ends  by  illustrating  the  procedure  with  an  example  worked  from  start 
to  finish. 


Example  3.5 

Solve  for  fl(s,  t )  the  partial  differential  equation 


dn  dn  d . 

S^  =  tW  +  SdJsTl) 

subject  to  the  initial  condition  n(s,f)  =  s  when  t  =  1. 


(3.10) 


Solution 

We  shall  follow  the  procedure  step  by  step. 

Firstly,  we  rewrite  the  partial  differential  equation  in  Lagrange  form.  Expanding 
the  last  term  in  Equation  (3.10),  we  have 


dn  dn  ,dn 

5—  =  t—  +  sn  +  s2— , 


ds 


dt 


ds 


so 

„  ,dn  dn 

s(1~s)*&-'^r=sn- 

This  is  now  in  Lagrange  form,  and 
/=  s(l  -  s),  g=-t, 


h  =  sYl. 


In  Step  2,  we  write  down  the  auxiliary  equations: 
ds  dt  dYl 

s(l  —  s)  —t  sll 

The  next  step  is  to  solve  the  auxiliary  equations,  writing  the  two  solutions  in  the 
form 

cl  =  <i>l{s,t,  n),  c2  =  02(s,t,n). 

Taking  the  first  and  third  expressions  together  and  cancelling  s  we  obtain 

so 

—  log(l  —  s)  =  logn  4-  constant. 

This  may  be  rewritten  as 

constant  =  log(l  —  s)  +  log  II 
or,  taking  exponentials, 

Ci  =  (l  -  s) n. 

The  second  solution  may  be  found  by  taking  the  first  and  second  expressions 
together  to  give 

ds  _  dt 
s(l  —  s)  —t' 

This  may  be  rewritten  as 


so 

logs  —  log(l  —  s)  =  —  logt  +  constant 
or 

constant  =  log(l  —  s)  —  logs  —  logt, 

giving 


1  —  s 


The  general  solution  is  obtained  in  Step  4.  In  this  case  it  is  convenient  Jo  use  the 
relation  cx  =  i/^(c2)  rather  than  c2  =  <A(^iX  t0  giye 

so  the  general  solution  of  the  partial  differential  equation  (3Jnt  is 

n  =  n(s,l)  =  Yzrg'l'yir)'  mi) 

In  the  final  step,  we  find  the  particular  solution  satisfying  the  given  initial 
condition  that  n(s,  t)  =  s  when  t  =  1.  Setting  t  equal  to  1  in  the  general  solution 
(3.1 1),  we  find  that 


= s(i  ■ 4 
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Now  we  must  identify  the  function  if/(x)  for  which  this  holds.  If  we  write 
x  =  (1  -  s)/s,  then  s  =  l/(x  +  1),  so 


< AM  = 


l 


x  +  1 

X 


1  - 


X  +  1 


(X+1)2' 

Using  this  in  the  general  solution  (3.11),  we  obtain  the  particular  solution 


n  (s,t)  =  — —  (— & — ^ ) 

i-A(i+(i-sy«V 


„  _  St 

1  (1-S  +  St)2' 

It  is  straightforward  to  check  that  this  satisfies  the  partial  differential  equation 
(3.10).  □ 


Now  that  we  have  a  method  for  solving  Lagrange’s  equation,  we  shall  return  to 
the  birth  process,  and  solve  the  partial  differential  equation  (2.9)  for  II(s,r),  the 
p.g.f.  of  X{t). 


4  Two  growing  populations 


In  this  section  we  look  at  the  properties  of  two  simple  models  for  increasing 
populations.  The  first  model  is  the  simple  birth  process,  which  was  discussed 
briefly  in  Section  2;  its  properties  are  developed  further  in  Subsection  4.1.  In 
Subsection  4.2  an  ‘arrival’  or  ‘immigration’  component  is  incorporated,  so  that  in 
the  second  model  the  community  evolves  not  just  as  a  consequence  of  births,  but 
also  due  to  arrivals  from  outside  who  then  give  birth  themselves.  Some  of  the 
properties  of  this  second  model  are  developed  on  the  audio-tape. 


4.1  The  simple  birth  process 


At  the  end  of  Section  2  we  left  our  discussion  of  the  simple  birth  process  after 
obtaining  a  partial  differential  equation  for  the  p.g.f.  of  X(t),  the  number  of 
individuals  alive  at  time  t.  The  procedure  described  in  Section  3  can  now  be  used 
to  solve  that  partial  differential  equation. 


Question  4.1  The  partial  differential  equation  for  LI(s,  t),  the  p.g.f.  of  the  number 
of  people  alive  at  time  t  in  a  simple  birth  process,  is 


Find  the  general  solution  of  this  partial  differential  equation,  and  show  that  the 
particular  solution  corresponding  to  the  case  AT(0)  =  1  is 
,-pt 


n  (s,t)  = 


se 


1  —  5(1  —  e~pt)' 


□ 


(4.1) 


See  Section  2,  Equation  (2.9). 


The  particular  solution  in  Result  (4.1)  is  the  p.g.f.  of  a  geometric  random  variable 
with  parameter  e~pt,  so  X(t)  ~  G1(e~pt)  and 

px(t)  =  P(X(t)  =  x)  =  e~p\\  -  e~pt)x~\  x  =  1,2,... ,  (4.2) 

these  probabilities  all  being  implicitly  conditional  on  the  event  [2f(0)  =  1], 


More  generally,  a  simple  birth  process  may  be  initiated  not  by  a  single  individual 
but  by  several,  so  that  AT(0)  =  x0  >  1.  In  this  case,  each  individual  generates 
independent  family  trees,  so  the  total  number  of  individuals  alive  at  time  t  is  the 
sum  of  x0  independent  identically  distributed  geometric  variates.  Hence  FI(s,  t),  the 
probability  generating  function  of  the  total  number  of  individuals  alive  at  time  r,  is 
the  product  of  x0  identical  p.g.f.’s  and  is  given  by 


n  (s,t)  = 


se 


-pt 


1  —  s(l  —  e~pt). 


This  is  the  p.g.f.  of  a  negative  binomial  distribution;  so,  in  a  simple  birth  process 
initiated  by  x0  individuals,  the  number  of  individuals  alive  at  time  t  has  a  negative 
binomial  distribution  with  parameters  x0,  e~p‘. 


Waiting  times 


The  distribution  of  X(t)  can  be  used  to  find  the  probability  distribution  of  the 
waiting  time  W„;  this  is  the  time  from  the  start  of  the  process  until  the  nth  birth. 
We  shall  do  this  for  a  simple  birth  process  initiated  by  a  single  individual;  but  first 
we  shall  find  the  mean  and  variance  of  Wn. 


You  will  recall  that  the  simple  birth  process  is  characterized  by  the  probability 
statement  (2.1): 

P(X(t  +  dt)  =  x  +  1 1  X(t)  =  x)  =  px  St  +  o(St). 

So,  when  there  are  x  individuals  in  the  population,  the  waiting  time  until  the  next 
birth  has  an  exponential  distribution,  M(/?x).  Assuming  A'(O)  =  1,  it  follows  that  Tu 
the  waiting  time  to  the  first  birth,  has  an  exponential  distribution  M(/?);  T2,  the 
waiting  time  between  the  first  and  second  births,  is  distributed  as  M(2/?);  T3,  the 
waiting  time  between  the  second  and  third  births,  is  distributed  as  M(3/?);  and  so 
on.  In  general,  Wn,  the  waiting  time  from  the  start  of  the  process  (at  time  0)  to  the 
time  of  the  nth  birth,  is  given  by 

Wn  =  Tl  +  T2  +  T3  +  ...  +  Tn. 

That  is,  W„  is  the  sum  of  n  independent  exponential  waiting  times  7},  where 
Tj  ~  M(;7?)  for  j  =  1, 2, . . . ,  n;  so 


E{Wn)  =  Em  +  E{T2)  +  E{T3)  +  ...  +  E(Tn) 
1  (t  1  1  1 
-^(1+2  +  3  +  -  +  « 


and 


V(K)  =  vm  +  V(T2)  +  V(T3)  +  ...  +  V(Tm) 
1  1 


-TTTl  1  +4  +  ^  +  ...+  — 


The  distribution  of  Wn  will  be  found  now,  by  using  the  distribution  of  Y(t),  which 
is  given  by  Equation  (4.2):  X(t)  ~  Gt{e~pt).  In  the  next  question  you  are  asked  to 
establish  a  relationship  between  the  distribution  functions  of  X{t)  and  Wn,  and 
hence  to  find  the  distribution  of  Wn. 


Question  4.2  Suppose  you  are  told  that,  for  a  simple  birth  process  initiated  by  a 
single  individual,  Wn,  the  waiting  time  to  the  nth  birth,  is  less  than  or  equal  to  t; 
that  is,  Wn  <  t. 

(i)  To  which  of  the  following  statements  about  the  population  size  at  time  t  is  this 
information  equivalent? 

(a)  X(t )  <  n  (b)  X(t)  =  n  (c)  X{t)  >  n  (d)  X(t)  >  n 

(ii)  Use  your  answer  to  part  (i)  to  sRovnMt 

P(Wn<t)  =  (\-e-pt)n,  t>  0.  □ 
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4.2  An  arrival  process  with  births 


In  this  subsection  a  model  is  described  for  a  population  in  which  both  arrivals  and 
births  are  taking  place.  Imagine  a  population  in  which  arrivals  occur  according  to 
a  Poisson  process  with  rate  X.  If  this  was  all  that  was  happening,  then  we  would 
have  the  simple  arrival  process  of  Section  1.  However,  let  us  suppose  further  that 
members  of  the  community  also  generate  offspring  according  to  the  simple  birth 
model  with  birth  rate  /?.  Then  this  process  is  known  as  the  immigration-birth 
process. 

To  set  up  the  postulates  of  the  process  we  require  the  conditional  probability 
P(X(t  +  St)  =  x  +  1 1  X(t)  =  x),  where  X(t)  is  the  size  of  the  population  at  time  t. 
Now,  if  X(t)  =  x,  then  the  instantaneous  birth  rate  for  the  process  is  fix. 
Independently  of  this,  there  is  the  possibility  of  an  arrival  from  outside;  these 
arrivals  occur  at  rate  X.  So  altogether  we  have 

P(X(t  +  St)  =  x  +  1 1  X(t)  =  x)  =  (X  +  fix)  St  +  o{St).  (4.3) 

This  matches  the  probability  statements  (1.1)  and  (2.1)  for  the  Poisson  process  and 
the  simple  birth  process.  Before  you  listen  to  the  analysis  of  this  stochastic 
immigration-birth  model  on  the  audio-tape,  we  shall  examine  the  corresponding 
deterministic  model. 


The  deterministic  model 

A  deterministic  model  ignores  the  randomness  inherent  in  the  process,  and 
demonstrates  instead  its  ‘average’  development  with  passing  time.  Deterministic 
formulations  for  several  continuous-time  random  processes  were  considered  in 
Unit  2,  Sections#.  There,  deterministic  models  were  constructed  for  the  Poisson 
process,  the  simple  birth  process  and  a  non-homogeneous  Poisson  process. 

In  each  of  these  examples,  an  ‘event’  corresponds  to  an  increase  of  one  in  the  size 
of  the  population  being  counted.  And  corresponding  to  the  probability  statement 
P(X{t  +  8t)  =  x  +  1 1  X(t)  =  x)  =  h(x,  t)  St  +  o(5t), 
which  characterizes  the  stochastic  model,  is  the  differential  equation 

<dz  ,  ,  V 

Tt  =  hM 

This  is  obtained  by  finding  the  expected  number  of  events  to  occur  in  the  time 
interval  [t,  t  +  5t].  The  solution  to  this  differential  equation  constitutes  the 
deterministic  formulation  required. 

In  cases  such  as  these,  where  each  event  corresponds  to  an  increase  in  the  size  of 
the  population,  it  is  simple  to  set  up  the  deterministic  model.  However,  there  are 
processes  where  an  ‘event’  corresponds  to  a  decrease  in  the  population  size — we 
shall  look  at  just  such  a  process  in  Section  5 — or  where  it  corresponds  sometimes 
to  an  increase  and  sometimes  to  a  decrease — for  instance,  births  and  deaths  in  a 
community,  or  arrivals  and  departures  of  aircraft  at  an  airport. 

When  increases  and  decreases  in  population  size  are  both  possible,  a  stochastic 
model  is  based  on  a  pair  of  equations: 

P(X(t  +  St)  =  x  +  1 1  X(t)  =  x)  =  hfa,  t)St  +  o(St),  (4.4a) 

P(X(t  +  St)  =  x  —  1 1  X(t)  =  x)  =  /i_  x(x,t)St  +  o(St).  (4.4b) 

Then  the  expected  change  in  population  size  during  the  time  interval  [r,  t  +  <5r], 
given  that  X(t)  =  x,  is 

1  x  (hfa,t)St  +  o(Stj)  +  (-1)  x  (h.fa,t)St  +  o(dt)) 

-t-  0  x  (1  —  ( hx(x,t)St  +  h-fa,t)St)  +  o{St)) 

—  ( hfa,t )  —  h_fa,t))St  +  o(St). 

The  deterministic  analogue  is  the  solution  of  the  differential  equation 

=  hfa,t)  -  h^fat).  (4.5) 


f./4d  4-1 

Examples  and  Question  5d"! 


Unit%  Equation  (5rt) 


Birth  and  death  processes  are 
considered  in  Unit  8,  and  arrival- 
departure  processes  in  Unit  9. 
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For  the  immigration-birth  process,  the  situation  is  not  as  complicated  as  this, 
since  the  only  change  possible  is  an  increase.  Using  Equation  (4.3),  we  have 
hy(z,  t)  —  1  +  1 6z,  h  _  x(z,  t)  =  0, 

and  so  Equation  (4.5)  becomes 
dz  i  n 

Tt  =  x  +  I*z’  (4-6) 

an  ordinary  differential  equation  which  can  be  solved  using  the  technique  of 
separation  of  variables. 


Question  4.3 

(i)  Solve  the  ordinary  differential  equation  (4.6),  assuming  that  the  population  size 
is  zero  at  time  t  =  0. 

(ii)  More  generally,  if  the  population  size  is  z0  at  time  0,  show  that  the 
corresponding  particular  solution  of  Equation  (4.6)  is 

z  =  z0ept  +  ^(ept  -  1).  □  (4.7) 

Example  4.1 

In  an  immigration-birth  process  the  immigration  rate  A  is  2  and  the  birth  rate  /? 
is  1.  If  the  population  size  is  initially  7,  according  to  the  deterministic  model  what 
size  will  the  population  reach  at  time  t  =  3? 

Solution 

The  population  size  at  time  t  is  given  by  Equation  (4.7).  Setting  X  =  2,  p  =  1, 
z0  =  7  and  t  =  3,  we  have 

z  =  le3  +  2(e3  —  1)  =  178.77, 

so  at  time  t  =  3  the  population  size  is  approximately  179.  □ 

Question  4.4  According  to  the  deterministic  immigration-birth  model,  how  long 
will  it  take  for  the  population  of  Example  4.1  to  attain  size  1000?  □ 


The  stochastic  model 


The  stochastic  model  for  the  immigration-birth  process  is  analysed  in  the  audio- 
tape  session  which  follows.  Starting  from  the  probability  statement  (4.3),  which 
characterizes  the  process,  we  go  through  all  the  steps  necessary  to  find  the  p.g.f.  of 
A'(t),  the  number  alive  at  time  t.  You  will  need  paper  to  write  on  as  you  work 
through  this  audio-tape  session. 

Now  switch  on  the  tape. 
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An  arrival  process  with  births 

A  population  grows  in  two  wags: 

(a)  somebodg  arrives  from  outside  -  arrival  rate  =  A; 

(b)  somebody  already  there  gives  birth -individual  birth  rafe=y6. 

Analysis  is  in  three  stages. 

Stage  I:  Obtain  the  differential-difference  e^Maf/ons  for  fpx(t)j. 
Stage  H:  Obtain  a  partial  differential  equation  for  the  p.g.f.  TT(s,  t). 
Stage  HI :  Solve  the  partial  differential  equation  to  find  TT  (s,  t). 


P(X(r+«tKx  +  l|  X  (t)  =  x)  =(  |  |+|  |)  5f  +  o(6t) 

< _ _ _ 


Stage  I  Obtainthe  differential-difference  equations  for  [px(t)J 
p0(t+6t)=  p0  (t)P(no  increase  in[t,  t+<5t]) 

=  PoO)| 


d\ 


px(t+6t)-px(t) 


Px(0  = 


4 y  Stage  II  Obtain  a  partial  differential  equation  for  the  p.g.f. TT(s,t) 

E  3fPx^)s  »^p0(t)+  E  JjPx(t)s 

x=0  x  =  l 

O0  00 

=  - Ap0 (t)  -  £  (A+/6x)px(t)sx+  £  (A+yS(x-0)px_, (t)s: 


=  -A 


-n 


00  00 
If  E  Px 0)sa=  IT (s,t),  then  ^  xpx(t)5x  =  s  ,  so 


2>s  ‘ 
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Stage  HI  Solve  the  partial  differential  ec\uai\on  fofmdTT(s,t) 

Step  1  Given  a  partial  differential  equation  in  which  the  first  partial 

9TT  9TT 

derivatives  |r  and  -|p  occur  only  linearly  (if  at  all),  and  in  which 
higher-order  derivatives  do  not  feature,  rewrite  it  in  Lagrange  form 

fM+aM_h 
f  9s  3  at  ~  h’ 

where  f,  q  and  h  are  functions  of  s,t  and  IT;  and 
identify  the  functions  f,  g  and  h. 


3TT  ,  3TT 

3s  3t 

,9=  ,  h= 

[b)  Step 2  Write  down  the  auxiliary  equations 

ds  _  dt  =  dTT 
f  g  h 


7)  Step 3 


Solve  the  auxiliary  equa+tons,  writing  your  two  solutions  in  the  form 
Ci  =  'Ms,t>Tr)1  cz  =  ^(s,t,TT). 

irri)ds=/M  i  /nds  =“/6dT[’ 


=  j3 1  +  constant 
=  x  constant. 


The  first  solution  is 
Cl  = 


so  A 


=-p 


or  constant  =A 

The  second  solution  is 

r— .□ 


J  +  constant 

+p 
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Step  4  Write  down  the  arbitrary  functional  equation 

c2  =  ^(ct) 

(or  c1  =v/r(c2)),  and  rewrite  it  in  as  simple  a  form  as  you  can  to  give 

the  function  TT  =  TT  (s,t)  standing  alone  on  the  left-hand  side  of  an  equation 

involving  s,f  and  the  arbitrary  function  \j/  on  the  right-hand  side. 


-  5  \  -/5t 


e  /5t  and  c?  =  sx  TT^. 


A  general  solution  can  be  obtained  from  c2  =  f  (c,);  that  is, 


=^( 


Now  raise  both  sides  to  the  power  so 

and  the  general  solution  is 


TT  =  TT  (s,t)  = 
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l)  ^ep  5  Find  the  particular  solution  for  a  given  initial  condition  by  identifying 
the  function  ^  using  the  initial  condition  and  then  substituting  for  f 
in  the  general  solution. 


When  t  =  0;  X(0)=x0)  so  TT(s,0)  = 


.  Putting  t  =  0  in  the  general  solution, 


we  have 


=  s'**  * 


To  find  (x),  put  x  =  ;  then  5  = 


.  This  gives 


l/r(x)  = 


Tr=Tr(s>t)  =  5^v((pi)e 


=  3-x/fi 


=  S-X//J 


This  is  the  p.y.f.  for  X(t)  in  an  arrival -birth  process  initiated 
by  jc0  individuals  present  at  time  t=  0. 
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jA  ^  j  oQ  qq 

PoW  rip,  (Os' 


^  IAJ 

=  - Ap0 (t)  -  £  (A+^x)px(t)sx+  £(A+/3(x-1))px_,(t)sx 

X  = 1  X= 1 

°-*E  |px('t;sx|-y6  £  lxpxg)s^+AsZ  [Px-,(t)5x~'|^3f;  la-op,,^ 


-  00  - 

^aE  Px(f)sx-p^  xpx(t)sx+As 
x=0  x=0  j 

QO  00 

If  E  Px(f)sx=  TT(s,t),  then  £  xpx(t)5x  =  s  fj  ,  sc 


ij  +^S 


=  -  A(1-s)  I  TT-|  ft»0-5)  |%j-  . 


fod-s)  i  pr 

gives  a  trio  of  equations  : 


-X  (1-s)  IT 


Rewriting  the  fraction  p[jT^y  as 


5  +  1-5 


this  is  the  same  as 


s  +  1-5 


ds=  /  jBdt, 


so  logs  -  log  (I -5)  =  yQt  +  constant 


ttt  =  e^  x  constant, 


which  gives 


5_  -jt 


c<=  FIe 


sds  =-J®dTT’ 


so  A  log  s  =  -y0  log  TT  +  constant 
or  constant  =  A  log  s  +y8  log  TT 
=  log  sA+  log  TT^ 

=  log  (sV), 


which  gives 


c2  =  sir1 


A  general  solution  can  be  obtained  from  c2  =  ^(c,);  that  is, 


ill  ri  e 


*  TT^  f  -L\.-0 


where  f  is  an  arbitrary  function.  Raising  both  sides  to  the  power  jp 


=H'0-rfck' 


where  f  is  an  arbitrary  function.  The  general  solution  is 
TT  =  TT  (s, t)  =  3*"  *  ((4)e-")  . 
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When  f  =  0,  X(0)  =  x0>  so  TT (s,0)  = 


Putting  [  =  0  in  the  general  solution, 


we  have 


so 


*0 


■  =-k"  t  ( 


1-5 


=  5 


x0+\/fi 


To  find  \|r  (x),  put  x  =  ;  then  s  = 


1+x 


This  gives 


Substituting  this  into  the  general  solution  to  find  the  particular  solution  for  X(0)  =  x0, 


7T  =  TT(s,t)  =  5-A/^ 


=  S-V/5 


Pi  e'* 


jc0  +A/0 


J  + 


s  \  -£t 

Fs)  * 


-  e-V/>  _ se 


-fit 


X0  +  K/fi 


=  s 


-s  +  se 


-fit 


In  the  audio-tape  session  it  was  shown  that,  for  the  immigration-birth  process 
with  initial  population  size  x0,  the  probability  generating  function  of  X(t)  is  given 
by 


\Xr)  +  XI B 


(  e Y"  •• 

“  U  -  5(1  -  €-*)) 
Writing  p  =  e~pt,  we  have 


/  se~pt  V° 

Vl  -s(l -«“*)/ 


n(s,  t )  = 


X 


(4.8) 


This  is  the  product  of  two  probability  generating  functions  of  negative  binomial 
form,  and  so  the  random  variable  X{t)  has  the  same  distribution  as  the  sum  of  two 
independent  random  variables  each  with  a  negative  binomial  distribution.  The  first 
random  variable,  with  p.g.f.  (p/(l  -  qsj)x/l1,  represents  the  arrivals  after  time  0  and 
their  offspring.  The  second,  with  p.g.f.  (ps/(l  -  qs))x°,  represents  those  who  were 
there  at  the  start,  if  any,  and  their  offspring;  the  p.g.f.  is  the  same  as  that  for  the 
number  alive  in  a  simple  birth  process  initiated  by  x0  individuals. 
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So  far  in  this  course,  any  negative  binomial  variates  that  you  have  met  have  arisen 
as  the  sum  of  independent  geometric  variates.  In  this  case,  however,  the  index  A/f} 
is  not  necessarily  an  integer,  so  the  negative  binomial  variate  cannot  be  regarded 
as  a  sum  of  geometric  variates;  but  using  the  Binomial  Theorem,  we  can  derive  the 
probability  distribution  corresponding  to  this  p.g.f.  The  coefficient  of  s*  in  the 
probability  generating  function 


where  a  is  not  necessarily  an  integer,  is 
'a  +  x  —  1 


P\\ 


so  P{X  =  0)  =  pa,  and 

(a  +  x  —  l)(a  +  x 


P(X  =  x)  = 


2) ...  a 


x! 


Pf 


x  =  1,  ...  • 


Question  4.5  Show  that  the  expected  number  of  individuals  alive  at  time  t  in  an 
immigration-birth  process  initiated  by  x0  individuals  is  equal  to  the  number  alive 
at  time  t  in  the  corresponding  deterministic  model;  that  is, 

£[X(t)]  =  x  o^  +  |(^'-l).  □ 


5  A  death  process 


This  unit  ends  with  a  look  at  a  population  in  which  there  are  no  births,  but  in 
which  deaths  do  occur.  Observation  starts  at  time  zero  with  several  individuals 
present;  independently  of  one  another,  these  individuals  die,  and  eventually  the 
population  dies  out  altogether.  The  process  discussed  in  this  section  is  known  as 

the  pure  death  process. 

For  the  pure  death  process  it  is  assumed  that  the  probability  that  a  specified 
individual  alive  at  time  t  dies  during  the  short  time  interval  [r,  f  +  8t]  is 
v5t  +  o(St).  If  the  community  is  of  size  x  at  time  f,  then  the  probability  of  a  death 
occurring  in  this  short  time  interval  is  vxSt  +  o(St);  and  if  somebody  does  die,  then 
the  size  of  the  population  is  reduced  by  one.  So 

P(X{l  +  5t)  =  x  -  1 1  X(t)  =  x)  =  vx  St  +  o(St).  (5.1) 

Given  the  initial  size  of  the  population,  the  sort  of  question  one  might  ask  is 
‘What  is  the  distribution  of  the  population  size  at  time  t?  or  ‘What  is  the 
distribution  of  the  time  at  which  the  population  size  falls  to  a  specified  level?’  or 
‘How  long  is  it  before  the  population  dies  out  altogether?’.  The  first  question  can 
be  answered  by  using  the  probability  statement  (5.1)  to  establish  a  partial 
differential  equation  for  the  p.g.f.  of  X(t),  the  population  size  at  time  t,  and  solving 
this  equation;  no  particular  new  difficulty  arises  if  this  approach  is  taken. 


The  label  ‘simple  death  process’  is 
not  one  which  seems  to  be 
commonly  used,  although  it  would 
describe  rather  well  a  process  which 
in  many  respects  is  like  the  simple 
birth  process. 


Question  5.1  Derive  the  differential-difference  equations  for  the  pure  death 
process,  and  hence  show  that  TI(s,  t),  the  probability  generating  function  for  the 
population  size  at  time  t,  satisfies  the  partial  differential  equation 


SU  dll 

—  =  v(l-s)~.  □ 


(5.2) 


Having  found  the  partial  differential  equation  for  n(s,  t),  we  could  then  solve  it. 
However,  all  that  work  is  quite  unnecessary;  using  a  different  approach,  we  can 
find  the  distribution  of  X{t)  very  easily. 

If  for  any  individual  alive  at  time  t  the  probability  of  dying  during  the  short  time 
interval  [£,  t  -1-  is  v  St  +  o(St),  then  it  follows  that  in  this  community  individuals’ 
lifetimes  are  independently  exponentially  distributed  with  parameter  v. 

Question  5.2  If  lifetimes  follow  an  M(v)  distribution,  what  is  the  probability  that  a 
particular  individual  alive  at  time  zero  is  still  alive  at  time  r?  □ 
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Now,  since  the  probability  that  any  specified  individual  is  still  alive  at  time  t  ise~v‘, 
the  total  number  still  alive  at  time  t  out  of  an  initial  population  of  size  x0  is 
binomially  distributed  with  parameters  x0  and  e~vt\  that  is,  X(t)  ~  B(x0,e~vt). 

Question  5.3  Write  down  n(s,  t),  the  probability  generating  function  of  X{t)  for 
the  pure  death  process,  and  verify  that  it  satisfies  the  partial  differential  equation 
(5.2).  □ 

The  distribution  of  X(t)  can  be  used  to  answer  a  question  like  ‘How  long  is  it 
before  the  population  dies  out  altogether?’.  Suppose  the  time  of  the  last  death  is 
denoted  by  W.  Then  the  last  death  occurs  at  or  before  time  w  if  and  only  if  the 
population  size  is  zero  at  time  w;  that  is,  the  events  [_W <  w]  and  [X(w)  =  0]  are 
equivalent,  and  so 

P(W<w)  =  P(JT(w)  =  0). 

But  the  distribution  of  A'(w)  is  binomial  with  parameters  x0,  e~vw,  so 
P{W<  w)  =  (1  -  e~vw)x°, 
thus  giving  the  distribution  of  W. 

Question  5.4 

(i)  For  a  population  initially  of  size  x0,  write  down  the  distribution  of  the  time  to 
the  first  death,  and  of  the  time  between  the  first  death  and  the  second  death. 

(ii)  What  is  the  distribution  of  the  time  between  the  second  to  last  death  and  the 
last  death? 

(iii)  For  a  population  initially  of  size  x0,  write  down  the  mean  and  variance  of  the 
time  from  the  start  of  observation  to  the  last  death. 

(iv)  For  a  population  initially  of  size  10,  what  is  the  expected  waiting  time  until 
there  are  only  five  survivors  if  v  =  1?  What  is  the  expected  time  until  the 
population  dies  out?  □ 

Question  5.5 

(i)  Obtain  the  differential  equation  for  the  deterministic  model  of  the  pure  death 
process. 

(ii)  Show  that  for  a  population  with  v  =  1,  whose  size  is  10  at  time  0,  the 
population  size  at  time  t  is  given  by  z  =  10e-'. 

(iii)  According  to  this  model,  at  what  time  are  only  half  of  the  original  population 
still  alive?  When  does  the  population  die  out?  □ 

In  this  unit  we  have  looked  at  some  integer-valued  random  processes  developing 
in  continuous  time  which  are  either  non-increasing  or  non-decreasing.  Similar 
models  have  been  developed  for  processes  which  rise  and  fall — where  both  births 
and  deaths  occur,  for  instance,  or  where  there  are  departures  as  well  as  arrivals; 
some  models  of  this  type  are  considered  in  the  next  two  units. 


Objectives 


After  studying  this  unit  you  should  be  able  to: 

derive  the  differential-difference  equations  for  the  probability  distribution  {px(t)}  of 
a  given  integer-valued  continuous-time  random  process  {X(t);  t  >  0}  in  simple 
cases; 

rewrite  the  sequence  of  differential-difference  equations  as  a  partial  differential 
equation  for  n(s,  t),  the  probability  generating  function  of  the  random  variable  X(t); 

obtain  the  general  solution  of  a  partial  differential  equation  which  can  be  written 
in  Lagrange  form; 

obtain  the  particular  solution  for  given  initial  conditions; 

identify  the  probability  distribution  {px(t)}  corresponding  to  a  particular 
probability  generating  function  fl(s,  t). 


Appendix:  Solutions  to  questions 


Section  1 


Section  2 


4-1(0  f(x,y)  —  sin  (x2  +  y) 

Differentiating  /(x,y)  with  respect  to  x,  regarding  y  as  a 
constant,  gives  the  first  partial  derivative  with  respect  to  x: 

df 


dx 


=  2x  cos  (x“  +  y). 


And  differentiating  f(x,y )  with  respect  to  y,  regarding  x  as  a 
constant,  gives  the  first  partial  derivative  with  respect  to  y: 

—  =  COS  (x2  +  y). 

(ii)  g(x,  y)  =  xey  +  x2y 

Differentiating  g(x,y)  partially  with  respect  to  x  gives 
dg 

fx  =  e’  +  2xy, 

and  differentiating  partially  with  respect  to  y  gives 

~  =  xey  +  x2. 
dy 

1-2(0  f{x,y)  =  sin(x2  +  y) 

Using  Solution  1.1,  differentiating  partially  with  respect  to  x 
for  a  second  time  gives  the  second  partial  derivative  with 
respect  to  x: 

q'4 2  r 

^2  =  2  cos  (x2  +  y)  -  4x2  sin  (x2  +  y). 

Similarly,  the  second  partial  derivative  with  respect  to  y  is 

d2f  . 

^2=  —  sin(x2  +  y). 

The  mixed  derivative  is 

d2f  d  (df\  d,  l2 

a^  =  ^y  =  &;(cos(x  +J,)) 

=  —  2xsin(x2  +  y). 

As  a  check,  we  can  find  the  mixed  derivative  by 
differentiating  first  with  respect  to  x  then  with  respect  to  y, 
giving 

d2f  d  (df\  a  ,  2  ,  .. 

eiry=ry{rx)=ry{2xcos(x 

=  -2xsin(x2  +  y). 

(»)  g{x,y)  =  xey  +  x2y 
Again  using  Solution  1.1,  we  find 
d2g  _  ^ 

5x2  2y 
and 

d2g  _  y 

dy2  Xe  ' 

The  mixed  derivative  is 

d2g  d  ( 8g\  d  2 

dxdy  <5x\dyJ  dx(xe+x) 

=  +  2x. 

Equivalently, 

d2g  d  (dg\  d 

dxdy  5y\dxJ  dy{t  +  lxy) 

=  ey  +  2x. 


2.1  If 

n  =  n(s,o  =  f  Px(t)sx, 

x  =  0 

then  the  way  to  ‘bring  x  down’  so  that  it  is  a  coefficient  of 
terms  in  the  sum  is  to  differentiate  with  respect  to  s.  The  first 
partial  derivative  of  n(s,t)  with  respect  to  s  is 

I  PxMxs*"1. 

Ub  X  =  Q 

Now  this  contains  terms  in  sx~1  when  what  we  want  are 
terms  in  sx.  Multiplying  both  sides  by  s  gives 

<9n  “  1:0 

E  xpx(t)sx=  Y,  xpx(t)sx, 

0S  AT  =  0  x=l 

and  this  is  the  result  required. 


Section  3 

3.1  The  partial  differential  equation  (2.9)  for  the  p.g.f.  of 
population  size  in  the  simple  birth  process  is 

dn  dn 

_=_Wi_s)_ 

Rewritten  in  the  form  of  Lagrange’s  equation,  this  is 
0  ,dll  dn 

'Ss(1-s)17  +  ^  =  0' 

and  so 

/=  ps{\  -  s),  g=  1,  h  =  0. 


3.2  On  the  right-hand  side  the  expression  -z-(stn)  may  be 

expanded  as  (S 

|(stn)  =  tn  +  «f, 

yielding  the  partial  differential  equation 

dn  an  „  ,  dn 

‘~s;  =  s-er  +  stn+:i,-e; 

or 

£<1  _s  ^ls  ~  s~dt  =  stn' 
and  so 

f=t(l-s2),  g=-s,  h  =  stU. 

3.3  From  Solution  3.2  the  auxiliary  equations  are 

ds  dt  dll 


t(l  —  s2)  —  s  stn' 
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3.4  Taking  the  first  and  second  expressions  together,  we 
have 


ds 


dt 


t(l  -  s2)  —s’ 

and  this  equation  features  only  the  variables  s  and  t.  The 
variables  are  separable,  and  we  can  write  the  equation  as 


—  s 


1  -  s 


ds  —  t  dt, 


whose  solution  is 

i  log  ( 1  s2)  =  \t2  +  constant. 

This  is  the  first  solution  of  the  auxiliary  equations.  Taking 
the  second  and  third  expressions  together,  and  cancelling  s, 
gives 

dt  dU 
-1  “  tU 


From  this,  a  second  solution  is 

—  \t2  =  logn  +  constant. 

Alternatively,  if  you  took  the  first  and  third  expressions 
together,  you  should  have  obtained 

—  2  log  ( 1  —  s2)  =  log  fl  +  constant. 


3.5  The  first  solution  is 
log  (1  —  s2)  =  t2  +  constant 
or 

constant  =  log  ( 1  —  s2)  —  t2, 
which  may  be  rewritten  as 
c,  =(1  -s2)e-‘\ 

The  second  solution  is 
—\t2  =  logn  +  constant 
or 

constant  =  logn  +  ^-r2, 
which  may  be  rewritten  as 

c2  =  rv2/2. 

Alternatively,  the  solution 

—  1  log ( 1  -  s2)  =  logn  +  constant 
may  be  rewritten  as 
constant  =  (1  —  s2)n2. 


,  ...  ds  dt  d n 

3*6(0  —  =  —  =  -pr- 

t  —s  0 

From  the  first  and  second  expressions, 
—  sds  =  tdt , 
so 


sds  +  \tdt  =  0. 


Integrating,  we  have 
is2  +  \t2  =  constant, 
and  the  easiest  way  to  write  this  is  as 
ct  =  s2  +  t2. 

Since  the  third  expression  is  of  the  form  dTl/0,  we  may 
deduce  that  one  solution  is 
c2  =  n. 


....  ds  dt  dU 

00  n=T  =  T 

From  the  first  and  third  expressions, 
1  ds  =  I  UdU. 


Integrating,  we  find 
s  =  ±n2  +  constant, 
and  so 

c,  =  2s  -  n2. 

From  the  second  and  third  expressions, 
1  dt  =  f  1  dU 


t  =  n  +  constant, 
and  so 

c2  =  t  -  n. 

ds  dt  dU 
~0~ 


(iii) 


s  +  n  t  +  n 

The  third  expression  with  either  the  first  or  the  second  gives 
c,  =  n. 

Taking  the  first  and  second  expressions,  and  writing  n  as  cv 
we  find 


ds 


dt 


5  +  C,  t+c  j 

which  integrates  to  give 

log(s  +  c,)  =  log(r  +  c,)  +  constant, 
or 

S  +  Cj 

c  2  = - 

t  +  c , 

Recovering  the  value  of  c l5  we  obtain  as  our  second  solution 

s  +  n 
c'2  ~  t  +  n‘ 


3.7  The  two  solutions  of  the  auxiliary  equations  are 
ci  =  (1  -  s2)e-2 

and 

c2  =  n/'2. 

Therefore  the  general  solution  of  the  original  partial 
differential  equation  (3.2)  is 
c2  =  tfr(c,) 
or 

Tie'2'2  =  ,/,((l  -  sV'2); 
that  is 

n  =  e_,2/2^((l  -  s2)e-'2). 

3.8  From  Solution  3.7  we  have  the  general  solution 

n(M)  =  g-|2'V((l  -s2)e-'2). 

We  are  now  given  the  initial  condition  that  at  time  t  =  0  the 
function  FI(s,  t)  is  equal  to  s.  Setting  t  =  0  in  the  general 
solution,  it  follows  that 
s  =  iH  1  -s2). 

To  identify  the  function  i //,  set  1  —  s2  equal  to  x;  then 
s  =  y/l  —  x,  and  so 
l//{x)  =  J\  -  X. 

The  particular  solution  corresponding  to  the  given  initial 
condition  TT(s,  0)  =  s  is 

n {s,t)  =  e-'2>2j\  -(1  -s2)e~l2. 
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Section  4 


4.1  The  partial  differential  equation  for  the  simple  birth 
process  may  be  written  in  Lagrange  form  (Step  1)  as 


m 


S)^  + 


an 

dt 


=  0, 


so  /=  /?s(  1  —  s),  g  —  1 ,  h  =  0.  The  auxiliary  equations 
(Step  2)  are  therefore 

ds  _dt  _dU 
(HI  —  s)  7  “  IT' 

The  solution 


cx  =  n 


may  be  written  down  immediately.  The  first  and  second 
expressions  taken  together  give 


J 


1 

s(l  -s) 


ds  = 


Now 


_J _ =  1  1 

s(l  -  s)  s  +  1  —  s’ 
so  integration  leads  to 

logs  -  log (1  -  s)  =  (it  +  constant. 
This  can  be  rewritten  as 


and  Step  3  is  complete.  The  general  solution  (Step  4)  is  given 
by  c,  =  i (/{c2);  that  is, 

n(s,t)  =  ^( 

If  the  population  is  initially  of  size  1,  then  n(s,0)  =  s.  Setting 
t  equal  to  0  in  the  general  solution,  it  follows  that 


(ii)  It  has  already  been  shown  that  X{t)  ~  G,(e_/i'),  so 
P(X(t)  >n+\)=  £  P(X(t)  =  x) 

x  =  n+  1 

CO 

=  X  <?"*(1 -<?-*)*“ 1 

x  =  n+  1 

=  (1  -  e~p,)n. 

Since  the  events  W„  <  t  and  X(t)  >  n  +  1  are  equivalent,  their 
probabilities  are  the  same.  Thus 

p{wn  <  t)  =  (i  -  e-“y. 


4.3(i)  The  differential  equation 
dz 

n=x+Pz 

can  be  rewritten 
dz 


A  +  (h 


=  1  dt. 


giving 

log  (A  +  fiz )  =  (it  +  constant. 

Using  the  initial  condition  that  z  =  0  when  t  =  0,  the 
particular  solution  required  is 
log  (A  +  (iz)  =  (It  +  log  A 
or 


2  =  j  ^  ~  1)- 


(ii)  Given  the  initial  condition  that  z  =  z0  when  t  =  0,  the 
particular  solution  is 

log  (A  +  jffz)  =  fit  +  log  (A  +  /?z0), 
giving 

A  +  (iz  =  (A  +  (iz0)ept 
or 

z  =  zoep‘  +  |( e pt  -  1). 


•  •  S  X 

Writing  x  =  - - ,  we  have  s  =  - - ,  so 

i-s  1 +  x 


iA(x)  = 


1  +x 


The  particular  solution  corresponding  to  an  initial 
population  of  size  1  is 


n  (s,t)  = 


1  -  s 

s 


1  —  s 


,-fit 


-fit 


1  + 


1  —  s 


,-fit 


se 


-fit 


1  —  s(  1  -e-p,y 


4.2(i)  The  nth  birth  brings  the  population  size  up  to  n+  l, 
so  if  this  occurs  at  or  before  time  t  then  the  population  size 
at  time  t  will  be  at  least  n  +  1.  That  is,  Z(t)  >  n  +  1  or 
equivalently  Af(t)  >  n;  this  is  statement  (c).  Similarly,  if 
X(t)  >  n  +  1  then  the  nth  birth  must  have  occurred  at  or 
before  time  t;  that  is  Wn  <  t.  So  the  events  X{t)  >  n  and 
W„<t  are  equivalent. 


4.4  Setting  A  =  2,  (i  =  1  and  z0  =  7  in  Equation  (4.7),  the 
time  t  at  which  the  population  size  reaches  1000  is  the 
solution  of  the  equation 

1000  =  le'  +  2(e‘  -  1), 
or 

,  1002 


giving 
t  ~  4.71. 


So  after  an  increase  from  7  to  179  between  t  =  0  and  t  =  3, 
the  population  size  increases  to  1000  by  time  t  =  4.71.  This 
rapid  increase  is  due  to  the  exponential  term  in  Equation  (4.7). 


4.5  The  mean  of  a  negative  binomial  distribution  with 
p.g.f. 


1  —  qs 


.  aq 

1S  ~p’  an°  tae  mean  a  negative  binomial 


distribution  with  p.g.f. 

Pp  p 

A/l  -g-ft 

o-fit 


ps 


1  —  qs 


.  r 

is  so 
p 


-  +  x 
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Section  5 


5.1  From  Equation  (5.1)  we  have 

P(X(t  +  St)  =  x  —  1 1  X(t)  =  x)  =  vxSt  +  o(St). 

The  population  changes  size  only  when  a  death  occurs; 
otherwise  its  size  stays  the  same.  For  there  to  be  x  survivors 
alive  at  time  t  +  St ,  there  can  only  have  been  x  +  1  alive  at 
time  t,  one  of  whom  dies  during  the  interval  \t,t  +  <5t];  or  x 
alive  at  time  t,  all  of  whom  survive  the  interval  [f,  t  +  <5t]. 
Therefore  it  follows  that,  for  x  =  0, 1,...  , 

px(t  +  St)  =  px+1(t)(v(x  +  l)<5t  +  o(<5t)) 

+  p*(t)(l  -  vx  St  +  o(<5t))  +  o(St). 

Rearranging  this  and  letting  St  ->  0  leads  to 

Jt Px(t)  =  -vx px(t)  +  v(x  +  1) px+ , (f),  x  >  0. 

Multiplying  both  sides  by  sx,  and  summing  over  all  x  >  0,  we 
have 


dU  00  00 

T7=-v  I  xpx(t)sx  +  v^(.x+  l)p*+i(f)s* 

UL  x  =  0  x  =  0 

CC  00 

=  -  V  Z  Xpx{t)sx  +  V  Z  jPj{t)sJ-\ 
x=o  ;= o 

making  the  change  of  variable  j  =  x  +  1.  This  simplifies  to 

dU  dU  SU 

=  -vs—  +  v— - 
ot  os  ds 

=  v(1~s,ar 


5.2  If  T,  the  lifetime  of  a  member  of  the  community,  has  an 
M(v)  distribution,  then 

P(T>t)=  1  —  F(t)  =  e~v'. 


5.3  If  X(t)  has  a  binomial  distribution  with  parameters  x0 
and  e~vl,  then  its  p.g.f.  is 

IT(s,r)  =  (1  -  e~VI  +  se~v,)x°- 
Partial  differentiation  with  respect  to  s  gives 


~  =  x0(l  -  e~vt  +  se~'")x°~l  e~vl, 

and  partial  differentiation  with  respect  to  t  gives 

^  =  x0(  1  -  e~v‘  +  se~v,)x°~l  (1  -  s)ve~vl. 

It  follows  that 

du  dn 


as  required. 


5.4(i)  If  there  are  x0  individuals  alive  at  time  0,  then  the 
time  to  the  first  death  is  distributed  as  the  minimum  of  x0 
independent  exponential  variates  M(v);  that  is,  T,  ~  M(x0v). 
The  time  between  the  first  and  second  deaths  is 


T2  ~  M((x0  -  l)v). 


(ii)  After  the  second  to  last  death,  there  is  only  one 
individual  left  alive,  so  the  time  between  the  second  to  last 
death  and  the  last  death  is  TXo  ~  M(v). 


(iii)  W  =  Tx  +  T2  +  ...  +  TXq,  where  7}  ~  M((x0  +  1  —  j)v), 
and  the  times  between  deaths  are  independent,  so 


£(H')  =  i( 


1 

- h 

To 


V(W)  = 


j  + _ 

v2  V*o  (*o 


(iv)  Given  v  =  I,  the  expected  waiting  time  to  the  fifth 
death  (which  leaves  five  survivors)  is 

£(^5)  =  -n>  +  ?  +  £  +  4  +  £ 

=  0.6456. 

The  expected  waiting  time  for  the  population  to  die  out  is 
E(W)  =  i o +  £  +  ...+  1 
=  2.9290. 


5.5(i)  The  stochastic  pure  death  process  is  characterized  by 
the  probability  statement 

P(X(t  +  <5f)  =  x  -  1 1  X(t)  =  x)  =  vx  St  +  o(St). 

There  are  no  births.  In  the  notation  of  Equations  (4.4), 

/i,(x,f)  =  0,  h~i(x,  t)  =  vx; 

and  so,  using  Equation  (4.5),  the  deterministic  model  for  the 
pure  death  process  is  the  solution  of  the  differential  equation 
dz 

—  =  —  vz. 
dt 

(ii)  Integrating  this  differential  equation  using  separation  of 
variables,  we  have 


or 

log  z  =  constant  —  vf. 

The  particular  solution  corresponding  to  an  initial 
population  of  size  z0  is 

z  =  z0e~vl. 

If  z0  =  10  and  v  =  1,  then 
z  =  10e~'. 

(iii)  Half  the  original  population  will  be  alive  when  z  =  5; 
that  is,  when 

5=  10<?~', 
which  gives 

t  =  log2  =  0.6931. 

From  Solution  5.4(iv),  the  corresponding  time  in  the 
stochastic  model  is  0.6456,  so  the  stochastic  and  deterministic 
models  give  roughly  similar  answers  in  this  case.  However, 
since  10e~f  >  0  for  all  t  >  0,  the  population  never  dies  out 
completely  in  the  deterministic  model,  unlike  in  the 
stochastic  model  where  the  average  time  until  the  population 
dies  out  is  2.9290. 
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